May 28 18:45:55.310647 ip-10-0-134-108 systemd[1]: Starting Kubernetes Kubelet...
May 28 18:45:55.806784 ip-10-0-134-108 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:45:55.806784 ip-10-0-134-108 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 18:45:55.806784 ip-10-0-134-108 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:45:55.806784 ip-10-0-134-108 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 18:45:55.806784 ip-10-0-134-108 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:45:55.808891 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.808745    2572 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 18:45:55.812938 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812919    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:45:55.812938 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812935    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:45:55.812938 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812940    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812944    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812949    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812953    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812957    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812961    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812965    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812968    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812973    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812977    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812981    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812985    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812989    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812993    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.812996    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813001    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813005    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813008    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813012    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813027    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:45:55.813120 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813032    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813036    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813040    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813044    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813048    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813052    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813056    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813060    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813064    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813069    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813073    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813077    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813082    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813086    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813093    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813097    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813102    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813106    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813110    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813114    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:45:55.813933 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813118    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813122    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813126    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813131    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813135    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813139    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813143    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813148    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813152    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813156    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813160    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813164    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813169    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813173    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813177    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813181    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813186    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813190    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813195    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:45:55.814665 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813199    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813208    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813213    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813220    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813226    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813232    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813237    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813242    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813248    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813252    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813257    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813261    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813268    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813273    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813278    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813283    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813287    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813292    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813296    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:45:55.815125 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813300    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813303    2572 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813308    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813312    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813316    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813320    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813939    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813949    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813954    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813959    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813963    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813967    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813971    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813976    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813980    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813984    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813989    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813993    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.813997    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814001    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:45:55.815622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814006    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814011    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814016    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814021    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814025    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814029    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814033    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814037    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814041    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814045    2572 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814050    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814054    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814058    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814062    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814066    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814070    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814074    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814078    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814082    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814086    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:45:55.816213 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814090    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814095    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814099    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814103    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814107    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814111    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814115    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814119    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814123    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814127    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814132    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814135    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814141    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814148    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814152    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814156    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814161    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814164    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814171    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:45:55.817100 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814177    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814182    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814187    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814192    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814196    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814200    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814204    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814209    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814213    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814217    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814221    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814225    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814229    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814234    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814239    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814243    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814247    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814251    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814257    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814261    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:45:55.817726 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814265    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814269    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814274    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814278    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814282    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814289    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814293    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814298    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814302    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814306    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814311    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814314    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.814318    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.815968    2572 flags.go:64] FLAG: --address="0.0.0.0"
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.815985    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.815997    2572 flags.go:64] FLAG: --anonymous-auth="true"
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816004    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816012    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816017    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816024    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816031    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 18:45:55.818199 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816036    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816041    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816047    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816053    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816058    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816064    2572 flags.go:64] FLAG: --cgroup-root=""
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816069    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816074    2572 flags.go:64] FLAG: --client-ca-file=""
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816079    2572 flags.go:64] FLAG: --cloud-config=""
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816084    2572 flags.go:64] FLAG: --cloud-provider="external"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816089    2572 flags.go:64] FLAG: --cluster-dns="[]"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816095    2572 flags.go:64] FLAG: --cluster-domain=""
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816100    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816105    2572 flags.go:64] FLAG: --config-dir=""
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816110    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816116    2572 flags.go:64] FLAG: --container-log-max-files="5"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816123    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816128    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816133    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816139    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816144    2572 flags.go:64] FLAG: --contention-profiling="false"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816149    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816154    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816159    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816164    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 18:45:55.818835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816171    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816176    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816181    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816186    2572 flags.go:64] FLAG: --enable-load-reader="false"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816191    2572 flags.go:64] FLAG: --enable-server="true"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816196    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816204    2572 flags.go:64] FLAG: --event-burst="100"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816209    2572 flags.go:64] FLAG: --event-qps="50"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816213    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816219    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816223    2572 flags.go:64] FLAG: --eviction-hard=""
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816229    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816234    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816240    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816245    2572 flags.go:64] FLAG: --eviction-soft=""
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816250    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816255    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816260    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816265    2572 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816270    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816274    2572 flags.go:64] FLAG: --fail-swap-on="true"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816279    2572 flags.go:64] FLAG: --feature-gates=""
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816286    2572 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816292    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816297    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 18:45:55.819605 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816303    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816308    2572 flags.go:64] FLAG: --healthz-port="10248"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816313    2572 flags.go:64] FLAG: --help="false"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816318    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-134-108.ec2.internal"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816323    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816329    2572 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816334    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816340    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816345    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816350    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816356    2572 flags.go:64] FLAG: --image-service-endpoint=""
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816360    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816365    2572 flags.go:64] FLAG: --kube-api-burst="100"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816370    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816375    2572 flags.go:64] FLAG: --kube-api-qps="50"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816394    2572 flags.go:64] FLAG: --kube-reserved=""
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816400    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816404    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816410    2572 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816414    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816419    2572 flags.go:64] FLAG: --lock-file=""
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816425    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816429    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816434    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 18:45:55.820316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816443    2572 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816448    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816453    2572 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816457    2572 flags.go:64] FLAG: --logging-format="text"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816462    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816468    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816473    2572 flags.go:64] FLAG: --manifest-url=""
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816478    2572 flags.go:64] FLAG: --manifest-url-header=""
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816486    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816491    2572 flags.go:64] FLAG: --max-open-files="1000000"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816498    2572 flags.go:64] FLAG: --max-pods="110"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816502    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816508    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816513    2572 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816518    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816523    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816528    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816534    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816545    2572 flags.go:64] FLAG: --node-status-max-images="50"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816550    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816555    2572 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816560    2572 flags.go:64] FLAG: --pod-cidr=""
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816565    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 18:45:55.820977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816584    2572 flags.go:64] FLAG: --pod-manifest-path=""
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816589    2572 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816594    2572 flags.go:64] FLAG: --pods-per-core="0"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816598    2572 flags.go:64] FLAG: --port="10250"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816604    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816609    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0056efcab07bacbb3"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816614    2572 flags.go:64] FLAG: --qos-reserved=""
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816620    2572 flags.go:64] FLAG: --read-only-port="10255"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816624    2572 flags.go:64] FLAG: --register-node="true"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816629    2572 flags.go:64] FLAG: --register-schedulable="true"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816634    2572 flags.go:64] FLAG: --register-with-taints=""
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816649    2572 flags.go:64] FLAG: --registry-burst="10"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816653    2572 flags.go:64] FLAG: --registry-qps="5"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816658    2572 flags.go:64] FLAG: --reserved-cpus=""
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816664    2572 flags.go:64] FLAG: --reserved-memory=""
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816671    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816681    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816686    2572 flags.go:64] FLAG: --rotate-certificates="false"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816691    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816696    2572 flags.go:64] FLAG: --runonce="false"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816701    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816706    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816711    2572 flags.go:64] FLAG: --seccomp-default="false"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816717    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816722    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816727    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 18:45:55.821604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816732    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816737    2572 flags.go:64] FLAG: --storage-driver-password="root"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816742    2572 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816747    2572 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816752    2572 flags.go:64] FLAG: --storage-driver-user="root"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816757    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816762    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816767    2572 flags.go:64] FLAG: --system-cgroups=""
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816771    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816781    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816786    2572 flags.go:64] FLAG: --tls-cert-file=""
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816791    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816798    2572 flags.go:64] FLAG: --tls-min-version=""
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816803    2572 flags.go:64] FLAG: --tls-private-key-file=""
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816808    2572 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816813    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816818    2572 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816824    2572 flags.go:64] FLAG: --v="2"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816831    2572 flags.go:64] FLAG: --version="false"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816837    2572 flags.go:64] FLAG: --vmodule=""
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816843    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.816851    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817005    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817013    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:45:55.822284 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817017    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817022    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817026    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817030    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817034    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817038    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817043    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817049    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817055    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817059    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817064    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817069    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817073    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817077    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817082    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817086    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817091    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817095    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817100    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:45:55.822878 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817103    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817108    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817112    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817116    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817121    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817125    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817129    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817134    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817138    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817142    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817149    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817155    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817160    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817164    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817168    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817172    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817177    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817181    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817185    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817190    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:45:55.823346 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817194    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817198    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817203    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817207    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817211    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817215    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817220    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817224    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817228    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817233    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817237    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817241    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817245    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817249    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817254    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817258    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817262    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817267    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817272    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817276    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:45:55.823862 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817281    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817285    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817291    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817297    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817301    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817305    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817310    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817314    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817318    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817322    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817326    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817330    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817334    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817339    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817346    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817352    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817357    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817362    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817366    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:45:55.824475 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817371    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:45:55.825222 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817375    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:45:55.825222 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817379    2572 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:45:55.825222 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817400    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:45:55.825222 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817404    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:45:55.825222 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.817408    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:45:55.825222 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.818377    2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:45:55.827550 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.827531    2572 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 18:45:55.827550 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.827551    2572 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827599    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827604    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827608    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827612    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827615    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827618    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827620    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827623    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827626    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827628    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827631    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827633    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827636    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827639    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:45:55.827634 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827642    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827645    2572 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827648    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827651    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827654    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827656    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827659    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827662    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827665    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827668    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827671    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827673    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827676    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827678    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827681    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827684    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827687    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827689    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827692    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827694    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:45:55.828030 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827697    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827699    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827702    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827705    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827707    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827710    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827713    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827716    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827719    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827722    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827725    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827727    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827730    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827732    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827735    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827738    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827741    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827743    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827746    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:45:55.828620 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827748    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827752    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827756    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827759    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827762    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827764    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827767    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827769    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827772    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827775    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827778    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827780    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827783    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827785    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827788    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827791    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827793    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827797    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827802    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:45:55.829082 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827805    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827807    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827810    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827813    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827816    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827818    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827821    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827824    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827827    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827830    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827832    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827835    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827837    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827840    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.827845    2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827936    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:45:55.829570 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827941    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827944    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827948    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827951    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827954    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827956    2572 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827959    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827962    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827964    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827967    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827970    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827973    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827976    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827979    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827982    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827984    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827987    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827990    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827993    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827996    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:45:55.829967 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.827999    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828003    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828006    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828008    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828011    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828014    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828017    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828019    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828022    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828024    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828027    2572 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828030    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828032    2572 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828035    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828038    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828041    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828043    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828046    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828049    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828052    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:45:55.830560 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828054    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828057    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828059    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828062    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828064    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828067    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828069    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828072    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828074    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828077    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828079    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828082    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828085    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828088    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828092    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828094    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828097    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828100    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828102    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:45:55.831056 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828105    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828108    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828111    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828113    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828116    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828118    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828121    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828125    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828128    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828130    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828133    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828136    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828138    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828141    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828143    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828145    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828148    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828150    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828153    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:45:55.831573 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828157    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:45:55.832035 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828161    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:45:55.832035 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828163    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:45:55.832035 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828167    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:45:55.832035 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828169    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:45:55.832035 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828172    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:45:55.832035 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:55.828175    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:45:55.832035 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.828180    2572 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:45:55.832035 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.829006    2572 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 18:45:55.834761 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.834747    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 18:45:55.835889 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.835877    2572 server.go:1019] "Starting client certificate rotation"
May 28 18:45:55.835991 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.835978    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 18:45:55.836026 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.836010    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 18:45:55.863521 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.863503    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 18:45:55.865378 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.865360    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 18:45:55.880947 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.880932    2572 log.go:25] "Validated CRI v1 runtime API"
May 28 18:45:55.887211 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.887197    2572 log.go:25] "Validated CRI v1 image API"
May 28 18:45:55.890562 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.890547    2572 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 18:45:55.896057 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.896036    2572 fs.go:135] Filesystem UUIDs: map[5bbb7bad-69e3-4635-bd83-d32204538307:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 814298a9-e4a6-4908-a33f-e65321cb12d6:/dev/nvme0n1p3]
May 28 18:45:55.896131 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.896055    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 18:45:55.900054 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.900035    2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 18:45:55.901425 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.901303    2572 manager.go:217] Machine: {Timestamp:2026-05-28 18:45:55.900824467 +0000 UTC m=+0.460599427 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105150 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20e9dd901be35dc682c5fb6cb10e8f SystemUUID:ec20e9dd-901b-e35d-c682-c5fb6cb10e8f BootID:e2b6796d-f9f8-4318-8913-df9354376358 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:b5:91:32:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:b5:91:32:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:2e:de:d8:c9:44 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 18:45:55.901425 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.901424    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 18:45:55.901544 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.901503    2572 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 18:45:55.904633 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.904608    2572 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 18:45:55.904764 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.904636    2572 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-108.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 18:45:55.904808 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.904774    2572 topology_manager.go:138] "Creating topology manager with none policy"
May 28 18:45:55.904808 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.904783    2572 container_manager_linux.go:306] "Creating device plugin manager"
May 28 18:45:55.904808 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.904791    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 18:45:55.905661 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.905651    2572 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 18:45:55.907017 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.907007    2572 state_mem.go:36] "Initialized new in-memory state store"
May 28 18:45:55.907124 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.907115    2572 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 18:45:55.909845 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.909835    2572 kubelet.go:491] "Attempting to sync node with API server"
May 28 18:45:55.909878 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.909849    2572 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 18:45:55.909878 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.909860    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 18:45:55.909878 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.909868    2572 kubelet.go:397] "Adding apiserver pod source"
May 28 18:45:55.909878 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.909878    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 18:45:55.911073 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.911061    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 18:45:55.911120 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.911080    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 18:45:55.914500 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.914483    2572 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 18:45:55.916980 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.916965    2572 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 18:45:55.918071 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.918054    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nczwk"
May 28 18:45:55.919150 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919138    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 18:45:55.919187 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919157    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 18:45:55.919187 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919163    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 18:45:55.919187 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919169    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 18:45:55.919187 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919178    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 18:45:55.919187 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919184    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 18:45:55.919316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919190    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 18:45:55.919316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919197    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 18:45:55.919316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919204    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 18:45:55.919316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919210    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 18:45:55.919316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919218    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 18:45:55.919316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919224    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 18:45:55.919316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919248    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 18:45:55.919316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.919253    2572 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 18:45:55.921944 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.921909    2572 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-108.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 18:45:55.922019 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:55.921971    2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 18:45:55.922086 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:55.922068    2572 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 18:45:55.922641 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.922629    2572 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 18:45:55.922685 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.922668    2572 server.go:1295] "Started kubelet"
May 28 18:45:55.922741 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.922715    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 18:45:55.922793 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.922746    2572 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 18:45:55.922842 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.922809    2572 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 18:45:55.923321 ip-10-0-134-108 systemd[1]: Started Kubernetes Kubelet.
May 28 18:45:55.923865 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.923846    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nczwk"
May 28 18:45:55.924292 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.924275    2572 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 18:45:55.924746 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.924724    2572 server.go:317] "Adding debug handlers to kubelet server"
May 28 18:45:55.933105 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.933019    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 18:45:55.933166 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:55.933105    2572 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 18:45:55.933688 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.933672    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 18:45:55.933886 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.933870    2572 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 18:45:55.933886 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.933886    2572 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 18:45:55.934011 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.933904    2572 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 18:45:55.934061 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.934049    2572 reconstruct.go:97] "Volume reconstruction finished"
May 28 18:45:55.934061 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.934060    2572 reconciler.go:26] "Reconciler: start to sync state"
May 28 18:45:55.934444 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.934428    2572 factory.go:55] Registering systemd factory
May 28 18:45:55.934444 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.934445    2572 factory.go:223] Registration of the systemd container factory successfully
May 28 18:45:55.934664 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.934650    2572 factory.go:153] Registering CRI-O factory
May 28 18:45:55.934727 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.934667    2572 factory.go:223] Registration of the crio container factory successfully
May 28 18:45:55.934727 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:55.934712    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:55.934830 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.934729    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 18:45:55.934830 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.934747    2572 factory.go:103] Registering Raw factory
May 28 18:45:55.934830 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.934763    2572 manager.go:1196] Started watching for new ooms in manager
May 28 18:45:55.935481 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.935463    2572 manager.go:319] Starting recovery of all containers
May 28 18:45:55.941175 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.941112    2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:45:55.943327 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:55.943266    2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-108.ec2.internal\" not found" node="ip-10-0-134-108.ec2.internal"
May 28 18:45:55.950940 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.950821    2572 manager.go:324] Recovery completed
May 28 18:45:55.955060 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.955044    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:45:55.956793 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.956779    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:45:55.956853 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.956806    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:45:55.956853 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.956816    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientPID"
May 28 18:45:55.957287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.957275    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 18:45:55.957287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.957287    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 18:45:55.957373 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.957302    2572 state_mem.go:36] "Initialized new in-memory state store"
May 28 18:45:55.961303 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.961290    2572 policy_none.go:49] "None policy: Start"
May 28 18:45:55.961303 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.961306    2572 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 18:45:55.961433 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.961317    2572 state_mem.go:35] "Initializing new in-memory state store"
May 28 18:45:55.997025 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.997009    2572 manager.go:341] "Starting Device Plugin manager"
May 28 18:45:56.011205 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:55.997041    2572 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 18:45:56.011205 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.997052    2572 server.go:85] "Starting device plugin registration server"
May 28 18:45:56.011205 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.997295    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 18:45:56.011205 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.997307    2572 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 18:45:56.011205 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.997467    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 18:45:56.011205 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.997570    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 18:45:56.011205 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:55.997589    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 18:45:56.011205 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:55.998088    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 18:45:56.011205 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:55.998133    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:56.054801 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.054771    2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 18:45:56.056005 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.055986    2572 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 18:45:56.056098 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.056009    2572 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 18:45:56.056098 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.056029    2572 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 18:45:56.056098 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.056037    2572 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 18:45:56.056098 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.056077    2572 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 18:45:56.062339 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.062317    2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:45:56.098265 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.098240    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:45:56.099246 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.099230    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:45:56.099340 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.099259    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:45:56.099340 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.099270    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientPID"
May 28 18:45:56.099340 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.099297    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-108.ec2.internal"
May 28 18:45:56.108506 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.108490    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-108.ec2.internal"
May 28 18:45:56.108545 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.108511    2572 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-108.ec2.internal\": node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:56.120231 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.120211    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:56.156511 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.156479    2572 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-108.ec2.internal"]
May 28 18:45:56.156608 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.156562    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:45:56.158035 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.158008    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:45:56.158130 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.158033    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:45:56.158130 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.158053    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientPID"
May 28 18:45:56.159109 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.159097    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:45:56.159286 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.159272    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.159347 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.159307    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:45:56.159877 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.159860    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:45:56.159958 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.159881    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:45:56.159958 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.159894    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:45:56.159958 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.159900    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:45:56.159958 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.159908    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientPID"
May 28 18:45:56.159958 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.159913    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientPID"
May 28 18:45:56.160899 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.160883    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.160996 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.160907    2572 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:45:56.161568 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.161553    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:45:56.161653 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.161578    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:45:56.161653 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.161590    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeHasSufficientPID"
May 28 18:45:56.186969 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.186952    2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-108.ec2.internal\" not found" node="ip-10-0-134-108.ec2.internal"
May 28 18:45:56.191146 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.191128    2572 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-108.ec2.internal\" not found" node="ip-10-0-134-108.ec2.internal"
May 28 18:45:56.221100 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.221077    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:56.236159 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.236133    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/17450dcbe864dfc632ba233f9a71ac7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal\" (UID: \"17450dcbe864dfc632ba233f9a71ac7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.236274 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.236168    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17450dcbe864dfc632ba233f9a71ac7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal\" (UID: \"17450dcbe864dfc632ba233f9a71ac7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.236274 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.236194    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c85ec789d0afbde36d31782bf9a2e069-config\") pod \"kube-apiserver-proxy-ip-10-0-134-108.ec2.internal\" (UID: \"c85ec789d0afbde36d31782bf9a2e069\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.321222 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.321143    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:56.336539 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.336505    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/17450dcbe864dfc632ba233f9a71ac7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal\" (UID: \"17450dcbe864dfc632ba233f9a71ac7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.336684 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.336544    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17450dcbe864dfc632ba233f9a71ac7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal\" (UID: \"17450dcbe864dfc632ba233f9a71ac7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.336684 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.336562    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c85ec789d0afbde36d31782bf9a2e069-config\") pod \"kube-apiserver-proxy-ip-10-0-134-108.ec2.internal\" (UID: \"c85ec789d0afbde36d31782bf9a2e069\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.336684 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.336598    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c85ec789d0afbde36d31782bf9a2e069-config\") pod \"kube-apiserver-proxy-ip-10-0-134-108.ec2.internal\" (UID: \"c85ec789d0afbde36d31782bf9a2e069\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.336684 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.336606    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/17450dcbe864dfc632ba233f9a71ac7f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal\" (UID: \"17450dcbe864dfc632ba233f9a71ac7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.336684 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.336612    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/17450dcbe864dfc632ba233f9a71ac7f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal\" (UID: \"17450dcbe864dfc632ba233f9a71ac7f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.421985 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.421941    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:56.489375 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.489337    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.493855 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.493832    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-108.ec2.internal"
May 28 18:45:56.522446 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.522422    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:56.622945 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.622875    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:56.723395 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.723355    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:56.823479 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.823436    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:56.825254 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.825236    2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:45:56.835462 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.835443    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 18:45:56.835572 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.835557    2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 18:45:56.835618 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.835600    2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 18:45:56.835656 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.835604    2572 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 18:45:56.923931 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:56.923854    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:56.927015 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.926991    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 18:40:55 +0000 UTC" deadline="2027-11-06 02:20:52.187593496 +0000 UTC"
May 28 18:45:56.927064 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.927015    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12631h34m55.260581006s"
May 28 18:45:56.933858 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.933843    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 18:45:56.941135 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.941120    2572 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 18:45:56.963892 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.963864    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cc64f"
May 28 18:45:56.969261 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:56.969243    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cc64f"
May 28 18:45:57.024268 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:57.024242    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:57.123310 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:57.123277    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85ec789d0afbde36d31782bf9a2e069.slice/crio-936e4735223d2142597afdf7521e37d0ecf3c8f142870cbe72a3669b8bee024f WatchSource:0}: Error finding container 936e4735223d2142597afdf7521e37d0ecf3c8f142870cbe72a3669b8bee024f: Status 404 returned error can't find the container with id 936e4735223d2142597afdf7521e37d0ecf3c8f142870cbe72a3669b8bee024f
May 28 18:45:57.123643 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:57.123624    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17450dcbe864dfc632ba233f9a71ac7f.slice/crio-58ae17eca6521d2fe701543b266bccd7df0930b7be081fd3f969e5bd298b6608 WatchSource:0}: Error finding container 58ae17eca6521d2fe701543b266bccd7df0930b7be081fd3f969e5bd298b6608: Status 404 returned error can't find the container with id 58ae17eca6521d2fe701543b266bccd7df0930b7be081fd3f969e5bd298b6608
May 28 18:45:57.124769 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:57.124755    2572 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-108.ec2.internal\" not found"
May 28 18:45:57.128281 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.128263    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:45:57.148921 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.148900    2572 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:45:57.234408 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.234325    2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal"
May 28 18:45:57.245097 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.245078    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 18:45:57.246178 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.246165    2572 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-108.ec2.internal"
May 28 18:45:57.253595 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.253583    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 18:45:57.788175 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.788145    2572 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:45:57.911917 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.911889    2572 apiserver.go:52] "Watching apiserver"
May 28 18:45:57.916941 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.916917    2572 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 18:45:57.918767 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.918734    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-nqb7t","openshift-image-registry/node-ca-z5b94","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal","openshift-multus/network-metrics-daemon-shplj","openshift-network-operator/iptables-alerter-skwhx","kube-system/konnectivity-agent-dscsk","kube-system/kube-apiserver-proxy-ip-10-0-134-108.ec2.internal","openshift-dns/node-resolver-6lnc4","openshift-multus/multus-additional-cni-plugins-kpd7z","openshift-multus/multus-d8s9c","openshift-network-diagnostics/network-check-target-7mbbk","openshift-ovn-kubernetes/ovnkube-node-drfnc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"]
May 28 18:45:57.923674 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.923651    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.926139 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.925515    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 18:45:57.926139 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.925741    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z5b94"
May 28 18:45:57.926139 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.925800    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 18:45:57.926139 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.925851    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:45:57.926139 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.926009    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9pw69\""
May 28 18:45:57.926139 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.926083    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 18:45:57.926139 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.926099    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 18:45:57.926139 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:57.926103    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:45:57.927485 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.927465    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 18:45:57.927698 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.927682    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 18:45:57.927768 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.927697    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 18:45:57.927863 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.927848    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kh4vn\""
May 28 18:45:57.930057 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.930039    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-skwhx"
May 28 18:45:57.931845 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.931826    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jt5w4\""
May 28 18:45:57.931845 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.931837    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 18:45:57.931996 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.931837    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 18:45:57.932615 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.932107    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 18:45:57.932615 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.932286    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dscsk"
May 28 18:45:57.932615 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.932404    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6lnc4"
May 28 18:45:57.933884 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.933867    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 18:45:57.934114 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.934098    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 18:45:57.934283 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.934261    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xs5fm\""
May 28 18:45:57.934378 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.934310    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 18:45:57.934911 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.934877    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 18:45:57.935129 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.935111    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-65b8j\""
May 28 18:45:57.936035 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.935465    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:57.937632 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.937438    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k2ck6\""
May 28 18:45:57.937632 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.937616    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 18:45:57.937782 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.937660    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 18:45:57.941720 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.941705    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:57.941829 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.941811    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:45:57.941944 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:57.941910    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:45:57.943463 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.943447    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 18:45:57.943550 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.943524    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 18:45:57.943633 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.943614    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-llrp7\""
May 28 18:45:57.944091 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.944070    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:57.945680 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.945663    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 18:45:57.945757 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.945665    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a13d797-b325-407d-a167-b39dbe3b2857-host\") pod \"node-ca-z5b94\" (UID: \"2a13d797-b325-407d-a167-b39dbe3b2857\") " pod="openshift-image-registry/node-ca-z5b94"
May 28 18:45:57.945757 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.945725    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cczzd\" (UniqueName: \"kubernetes.io/projected/2a13d797-b325-407d-a167-b39dbe3b2857-kube-api-access-cczzd\") pod \"node-ca-z5b94\" (UID: \"2a13d797-b325-407d-a167-b39dbe3b2857\") " pod="openshift-image-registry/node-ca-z5b94"
May 28 18:45:57.945877 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.945755    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlzd6\" (UniqueName: \"kubernetes.io/projected/a7cc5970-0522-44ea-b02e-1ff310c0793c-kube-api-access-xlzd6\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:45:57.945877 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.945793    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 18:45:57.945877 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.945814    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzm2n\" (UniqueName: \"kubernetes.io/projected/aaa45763-d22c-499b-a9c8-cd625e9c03cf-kube-api-access-fzm2n\") pod \"iptables-alerter-skwhx\" (UID: \"aaa45763-d22c-499b-a9c8-cd625e9c03cf\") " pod="openshift-network-operator/iptables-alerter-skwhx"
May 28 18:45:57.945877 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.945842    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cedd45a-9c5b-4d26-b004-7096a2103638-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:57.946069 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.945890    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cedd45a-9c5b-4d26-b004-7096a2103638-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:57.946069 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.945932    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-run-netns\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.946069 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.945966    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-conf-dir\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.946069 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.945987    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaa45763-d22c-499b-a9c8-cd625e9c03cf-host-slash\") pod \"iptables-alerter-skwhx\" (UID: \"aaa45763-d22c-499b-a9c8-cd625e9c03cf\") " pod="openshift-network-operator/iptables-alerter-skwhx"
May 28 18:45:57.946069 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946013    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:57.946069 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946037    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-run-multus-certs\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.946069 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946052    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-etc-kubernetes\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.946069 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946067    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7a43270-977b-4b7c-9832-872e8b54fa72-konnectivity-ca\") pod \"konnectivity-agent-dscsk\" (UID: \"f7a43270-977b-4b7c-9832-872e8b54fa72\") " pod="kube-system/konnectivity-agent-dscsk"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946086    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaa45763-d22c-499b-a9c8-cd625e9c03cf-iptables-alerter-script\") pod \"iptables-alerter-skwhx\" (UID: \"aaa45763-d22c-499b-a9c8-cd625e9c03cf\") " pod="openshift-network-operator/iptables-alerter-skwhx"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946108    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72cms\" (UniqueName: \"kubernetes.io/projected/f74161a4-02e9-4d30-869f-f53d4767c576-kube-api-access-72cms\") pod \"node-resolver-6lnc4\" (UID: \"f74161a4-02e9-4d30-869f-f53d4767c576\") " pod="openshift-dns/node-resolver-6lnc4"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946133    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-os-release\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946168    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cedd45a-9c5b-4d26-b004-7096a2103638-cni-binary-copy\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a1e17f8-bf36-455f-b124-a3beefa6850e-cni-binary-copy\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946215    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-var-lib-kubelet\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946237    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7a43270-977b-4b7c-9832-872e8b54fa72-agent-certs\") pod \"konnectivity-agent-dscsk\" (UID: \"f7a43270-977b-4b7c-9832-872e8b54fa72\") " pod="kube-system/konnectivity-agent-dscsk"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946268    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6c8tn\""
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a13d797-b325-407d-a167-b39dbe3b2857-serviceca\") pod \"node-ca-z5b94\" (UID: \"2a13d797-b325-407d-a167-b39dbe3b2857\") " pod="openshift-image-registry/node-ca-z5b94"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946297    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-os-release\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946319    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-socket-dir-parent\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946332    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946342    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-system-cni-dir\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946401    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-system-cni-dir\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946428    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-hostroot\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946440    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 18:45:57.946452 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbt2n\" (UniqueName: \"kubernetes.io/projected/9a1e17f8-bf36-455f-b124-a3beefa6850e-kube-api-access-kbt2n\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946475    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-cni-dir\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946490    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946497    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946402    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946558    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f74161a4-02e9-4d30-869f-f53d4767c576-hosts-file\") pod \"node-resolver-6lnc4\" (UID: \"f74161a4-02e9-4d30-869f-f53d4767c576\") " pod="openshift-dns/node-resolver-6lnc4"
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946607    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f74161a4-02e9-4d30-869f-f53d4767c576-tmp-dir\") pod \"node-resolver-6lnc4\" (UID: \"f74161a4-02e9-4d30-869f-f53d4767c576\") " pod="openshift-dns/node-resolver-6lnc4"
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946636    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbsjj\" (UniqueName: \"kubernetes.io/projected/7cedd45a-9c5b-4d26-b004-7096a2103638-kube-api-access-lbsjj\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946677    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-run-k8s-cni-cncf-io\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946711    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-var-lib-cni-bin\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946751    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-var-lib-cni-multus\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946772    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-daemon-config\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946793    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946813    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-cnibin\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:57.947204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.946842    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-cnibin\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:57.947908 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.947887    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 18:45:57.948226 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.948205    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 18:45:57.948316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.948256    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 18:45:57.948494 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.948472    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2pj82\""
May 28 18:45:57.969876 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.969848    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:40:56 +0000 UTC" deadline="2028-02-22 17:42:13.307145072 +0000 UTC"
May 28 18:45:57.969876 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:57.969876    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15238h56m15.337273803s"
May 28 18:45:58.009959 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.009934    2572 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:45:58.034989 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.034964    2572 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 18:45:58.048086 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.047998    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-kubelet\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.048086 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048043    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaa45763-d22c-499b-a9c8-cd625e9c03cf-iptables-alerter-script\") pod \"iptables-alerter-skwhx\" (UID: \"aaa45763-d22c-499b-a9c8-cd625e9c03cf\") " pod="openshift-network-operator/iptables-alerter-skwhx"
May 28 18:45:58.048086 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048084    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-os-release\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.048312 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048111    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-modprobe-d\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.048312 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048134    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-run\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.048312 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048158    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kksdd\" (UniqueName: \"kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd\") pod \"network-check-target-7mbbk\" (UID: \"0a9b903e-d81d-46cf-940e-6d3a8832ef61\") " pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:45:58.048312 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048181    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a13d797-b325-407d-a167-b39dbe3b2857-serviceca\") pod \"node-ca-z5b94\" (UID: \"2a13d797-b325-407d-a167-b39dbe3b2857\") " pod="openshift-image-registry/node-ca-z5b94"
May 28 18:45:58.048312 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048272    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-os-release\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.048312 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048257    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-systemd-units\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048315    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-log-socket\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048346    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-socket-dir-parent\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048373    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-hostroot\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048416    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbt2n\" (UniqueName: \"kubernetes.io/projected/9a1e17f8-bf36-455f-b124-a3beefa6850e-kube-api-access-kbt2n\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048445    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-run-ovn-kubernetes\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048448    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-socket-dir-parent\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048459    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-hostroot\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048473    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4f84636-68e1-4725-8733-3b652bc4b925-ovnkube-config\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048500    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f74161a4-02e9-4d30-869f-f53d4767c576-tmp-dir\") pod \"node-resolver-6lnc4\" (UID: \"f74161a4-02e9-4d30-869f-f53d4767c576\") " pod="openshift-dns/node-resolver-6lnc4"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048528    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbsjj\" (UniqueName: \"kubernetes.io/projected/7cedd45a-9c5b-4d26-b004-7096a2103638-kube-api-access-lbsjj\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048556    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-sysconfig\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.048681 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048662    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aaa45763-d22c-499b-a9c8-cd625e9c03cf-iptables-alerter-script\") pod \"iptables-alerter-skwhx\" (UID: \"aaa45763-d22c-499b-a9c8-cd625e9c03cf\") " pod="openshift-network-operator/iptables-alerter-skwhx"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048686    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4f84636-68e1-4725-8733-3b652bc4b925-env-overrides\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048717    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-run-k8s-cni-cncf-io\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048681    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a13d797-b325-407d-a167-b39dbe3b2857-serviceca\") pod \"node-ca-z5b94\" (UID: \"2a13d797-b325-407d-a167-b39dbe3b2857\") " pod="openshift-image-registry/node-ca-z5b94"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048750    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-var-lib-cni-bin\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048791    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-daemon-config\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048801    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-var-lib-cni-bin\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048823    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-run-k8s-cni-cncf-io\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048833    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-systemd\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048872    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-lib-modules\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048901    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-cnibin\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048928    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-cnibin\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048936    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-cnibin\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048951    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a13d797-b325-407d-a167-b39dbe3b2857-host\") pod \"node-ca-z5b94\" (UID: \"2a13d797-b325-407d-a167-b39dbe3b2857\") " pod="openshift-image-registry/node-ca-z5b94"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048977    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cedd45a-9c5b-4d26-b004-7096a2103638-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.048989    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-cnibin\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049003    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-run-netns\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049016    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a13d797-b325-407d-a167-b39dbe3b2857-host\") pod \"node-ca-z5b94\" (UID: \"2a13d797-b325-407d-a167-b39dbe3b2857\") " pod="openshift-image-registry/node-ca-z5b94"
May 28 18:45:58.049229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049028    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-run-multus-certs\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049039    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-run-netns\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049026    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f74161a4-02e9-4d30-869f-f53d4767c576-tmp-dir\") pod \"node-resolver-6lnc4\" (UID: \"f74161a4-02e9-4d30-869f-f53d4767c576\") " pod="openshift-dns/node-resolver-6lnc4"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049053    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-etc-kubernetes\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049060    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-run-multus-certs\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049086    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7a43270-977b-4b7c-9832-872e8b54fa72-konnectivity-ca\") pod \"konnectivity-agent-dscsk\" (UID: \"f7a43270-977b-4b7c-9832-872e8b54fa72\") " pod="kube-system/konnectivity-agent-dscsk"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049112    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-sys\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049089    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-etc-kubernetes\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049138    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaa45763-d22c-499b-a9c8-cd625e9c03cf-host-slash\") pod \"iptables-alerter-skwhx\" (UID: \"aaa45763-d22c-499b-a9c8-cd625e9c03cf\") " pod="openshift-network-operator/iptables-alerter-skwhx"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049162    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049189    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-slash\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049195    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aaa45763-d22c-499b-a9c8-cd625e9c03cf-host-slash\") pod \"iptables-alerter-skwhx\" (UID: \"aaa45763-d22c-499b-a9c8-cd625e9c03cf\") " pod="openshift-network-operator/iptables-alerter-skwhx"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049213    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-run-systemd\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049236    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-var-lib-openvswitch\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049265    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-72cms\" (UniqueName: \"kubernetes.io/projected/f74161a4-02e9-4d30-869f-f53d4767c576-kube-api-access-72cms\") pod \"node-resolver-6lnc4\" (UID: \"f74161a4-02e9-4d30-869f-f53d4767c576\") " pod="openshift-dns/node-resolver-6lnc4"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049292    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cedd45a-9c5b-4d26-b004-7096a2103638-cni-binary-copy\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049319    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a1e17f8-bf36-455f-b124-a3beefa6850e-cni-binary-copy\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.050051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049345    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-var-lib-kubelet\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049346    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-daemon-config\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049317    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049371    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7a43270-977b-4b7c-9832-872e8b54fa72-agent-certs\") pod \"konnectivity-agent-dscsk\" (UID: \"f7a43270-977b-4b7c-9832-872e8b54fa72\") " pod="kube-system/konnectivity-agent-dscsk"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049433    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-sysctl-conf\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049457    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-cni-bin\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049477    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-cni-netd\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049503    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-os-release\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-sys-fs\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049555    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cedd45a-9c5b-4d26-b004-7096a2103638-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049580    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4f84636-68e1-4725-8733-3b652bc4b925-ovnkube-script-lib\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049627    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-system-cni-dir\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049650    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-os-release\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049653    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7a43270-977b-4b7c-9832-872e8b54fa72-konnectivity-ca\") pod \"konnectivity-agent-dscsk\" (UID: \"f7a43270-977b-4b7c-9832-872e8b54fa72\") " pod="kube-system/konnectivity-agent-dscsk"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049668    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cedd45a-9c5b-4d26-b004-7096a2103638-system-cni-dir\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049700    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-system-cni-dir\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.050730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049729    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-socket-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049735    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-var-lib-kubelet\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049694    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049754    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzvfb\" (UniqueName: \"kubernetes.io/projected/e80b9bcd-7737-4ecc-a17f-98af24a65334-kube-api-access-nzvfb\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049782    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-cni-dir\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049788    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-system-cni-dir\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049806    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049833    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f74161a4-02e9-4d30-869f-f53d4767c576-hosts-file\") pod \"node-resolver-6lnc4\" (UID: \"f74161a4-02e9-4d30-869f-f53d4767c576\") " pod="openshift-dns/node-resolver-6lnc4"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049841    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-cni-dir\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049857    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/665485ca-0a37-4609-8487-e43115703513-tmp\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049883    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64chx\" (UniqueName: \"kubernetes.io/projected/665485ca-0a37-4609-8487-e43115703513-kube-api-access-64chx\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049905    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-run-netns\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.049917    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049928    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-etc-openvswitch\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.049952    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4f84636-68e1-4725-8733-3b652bc4b925-ovn-node-metrics-cert\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050013    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f74161a4-02e9-4d30-869f-f53d4767c576-hosts-file\") pod \"node-resolver-6lnc4\" (UID: \"f74161a4-02e9-4d30-869f-f53d4767c576\") " pod="openshift-dns/node-resolver-6lnc4"
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.050035    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs podName:a7cc5970-0522-44ea-b02e-1ff310c0793c nodeName:}" failed. No retries permitted until 2026-05-28 18:45:58.549966948 +0000 UTC m=+3.109741894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs") pod "network-metrics-daemon-shplj" (UID: "a7cc5970-0522-44ea-b02e-1ff310c0793c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:45:58.051451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050033    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cedd45a-9c5b-4d26-b004-7096a2103638-cni-binary-copy\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050059    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-var-lib-cni-multus\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050092    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a1e17f8-bf36-455f-b124-a3beefa6850e-cni-binary-copy\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050102    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-host-var-lib-cni-multus\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050153    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-kubernetes\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050179    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050205    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-run-ovn\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050229    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-node-log\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050253    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-var-lib-kubelet\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-host\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050314    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050334    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-run-openvswitch\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050357    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cczzd\" (UniqueName: \"kubernetes.io/projected/2a13d797-b325-407d-a167-b39dbe3b2857-kube-api-access-cczzd\") pod \"node-ca-z5b94\" (UID: \"2a13d797-b325-407d-a167-b39dbe3b2857\") " pod="openshift-image-registry/node-ca-z5b94"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050380    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlzd6\" (UniqueName: \"kubernetes.io/projected/a7cc5970-0522-44ea-b02e-1ff310c0793c-kube-api-access-xlzd6\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050418    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzm2n\" (UniqueName: \"kubernetes.io/projected/aaa45763-d22c-499b-a9c8-cd625e9c03cf-kube-api-access-fzm2n\") pod \"iptables-alerter-skwhx\" (UID: \"aaa45763-d22c-499b-a9c8-cd625e9c03cf\") " pod="openshift-network-operator/iptables-alerter-skwhx"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050438    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cedd45a-9c5b-4d26-b004-7096a2103638-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050458    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-conf-dir\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.052210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050479    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-sysctl-d\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.052825 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050499    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-registration-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.052825 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050543    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a1e17f8-bf36-455f-b124-a3beefa6850e-multus-conf-dir\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.052825 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050647    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fbw8\" (UniqueName: \"kubernetes.io/projected/e4f84636-68e1-4725-8733-3b652bc4b925-kube-api-access-7fbw8\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.052825 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050695    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/665485ca-0a37-4609-8487-e43115703513-etc-tuned\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.052825 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050721    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-device-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.052825 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.050921    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cedd45a-9c5b-4d26-b004-7096a2103638-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.054856 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.054825    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7a43270-977b-4b7c-9832-872e8b54fa72-agent-certs\") pod \"konnectivity-agent-dscsk\" (UID: \"f7a43270-977b-4b7c-9832-872e8b54fa72\") " pod="kube-system/konnectivity-agent-dscsk"
May 28 18:45:58.057449 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.057396    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72cms\" (UniqueName: \"kubernetes.io/projected/f74161a4-02e9-4d30-869f-f53d4767c576-kube-api-access-72cms\") pod \"node-resolver-6lnc4\" (UID: \"f74161a4-02e9-4d30-869f-f53d4767c576\") " pod="openshift-dns/node-resolver-6lnc4"
May 28 18:45:58.058162 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.058140    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbsjj\" (UniqueName: \"kubernetes.io/projected/7cedd45a-9c5b-4d26-b004-7096a2103638-kube-api-access-lbsjj\") pod \"multus-additional-cni-plugins-kpd7z\" (UID: \"7cedd45a-9c5b-4d26-b004-7096a2103638\") " pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.059305 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.059251    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlzd6\" (UniqueName: \"kubernetes.io/projected/a7cc5970-0522-44ea-b02e-1ff310c0793c-kube-api-access-xlzd6\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:45:58.059857 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.059715    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzm2n\" (UniqueName: \"kubernetes.io/projected/aaa45763-d22c-499b-a9c8-cd625e9c03cf-kube-api-access-fzm2n\") pod \"iptables-alerter-skwhx\" (UID: \"aaa45763-d22c-499b-a9c8-cd625e9c03cf\") " pod="openshift-network-operator/iptables-alerter-skwhx"
May 28 18:45:58.059857 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.059763    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbt2n\" (UniqueName: \"kubernetes.io/projected/9a1e17f8-bf36-455f-b124-a3beefa6850e-kube-api-access-kbt2n\") pod \"multus-d8s9c\" (UID: \"9a1e17f8-bf36-455f-b124-a3beefa6850e\") " pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.061587 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.061544    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-108.ec2.internal" event={"ID":"c85ec789d0afbde36d31782bf9a2e069","Type":"ContainerStarted","Data":"936e4735223d2142597afdf7521e37d0ecf3c8f142870cbe72a3669b8bee024f"}
May 28 18:45:58.061680 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.061652    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cczzd\" (UniqueName: \"kubernetes.io/projected/2a13d797-b325-407d-a167-b39dbe3b2857-kube-api-access-cczzd\") pod \"node-ca-z5b94\" (UID: \"2a13d797-b325-407d-a167-b39dbe3b2857\") " pod="openshift-image-registry/node-ca-z5b94"
May 28 18:45:58.063067 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.063039    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal" event={"ID":"17450dcbe864dfc632ba233f9a71ac7f","Type":"ContainerStarted","Data":"58ae17eca6521d2fe701543b266bccd7df0930b7be081fd3f969e5bd298b6608"}
May 28 18:45:58.151446 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151410    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/665485ca-0a37-4609-8487-e43115703513-tmp\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.151446 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151442    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64chx\" (UniqueName: \"kubernetes.io/projected/665485ca-0a37-4609-8487-e43115703513-kube-api-access-64chx\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151460    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-run-netns\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151476    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-etc-openvswitch\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151499    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4f84636-68e1-4725-8733-3b652bc4b925-ovn-node-metrics-cert\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151523    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-kubernetes\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151532    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-run-netns\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151542    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-etc-openvswitch\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151547    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151593    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151607    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-run-ovn\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151627    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-node-log\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151627    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-kubernetes\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151652    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-var-lib-kubelet\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.151660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151665    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-run-ovn\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151674    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-host\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151682    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-node-log\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151705    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151721    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-var-lib-kubelet\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151728    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-host\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151732    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-run-openvswitch\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151764    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-sysctl-d\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151786    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-registration-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151803    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-run-openvswitch\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151810    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fbw8\" (UniqueName: \"kubernetes.io/projected/e4f84636-68e1-4725-8733-3b652bc4b925-kube-api-access-7fbw8\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151863    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/665485ca-0a37-4609-8487-e43115703513-etc-tuned\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151890    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-device-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151893    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-etc-selinux\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151919    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-kubelet\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151944    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-modprobe-d\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151966    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-run\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.151990    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kksdd\" (UniqueName: \"kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd\") pod \"network-check-target-7mbbk\" (UID: \"0a9b903e-d81d-46cf-940e-6d3a8832ef61\") " pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152013    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-sysctl-d\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152016    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-systemd-units\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152046    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-systemd-units\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152049    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-log-socket\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152065    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-registration-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152094    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-log-socket\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152097    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-device-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152120    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-run-ovn-kubernetes\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152150    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-modprobe-d\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152159    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-run-ovn-kubernetes\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152191    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-kubelet\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152204    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-run\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152290    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4f84636-68e1-4725-8733-3b652bc4b925-ovnkube-config\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152320    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-sysconfig\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152348    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4f84636-68e1-4725-8733-3b652bc4b925-env-overrides\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152374    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-systemd\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152411    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-lib-modules\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.152903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152430    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-sysconfig\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152442    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-sys\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152470    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-systemd\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152471    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-slash\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152503    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-slash\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152520    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-run-systemd\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152551    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-var-lib-openvswitch\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152590    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-sysctl-conf\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152588    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-run-systemd\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152614    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-cni-bin\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152637    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-var-lib-openvswitch\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152642    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-cni-netd\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152679    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-cni-netd\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152552    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-sys\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152695    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-sys-fs\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152724    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152752    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4f84636-68e1-4725-8733-3b652bc4b925-ovnkube-script-lib\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.153796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152779    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-socket-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.154592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152806    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzvfb\" (UniqueName: \"kubernetes.io/projected/e80b9bcd-7737-4ecc-a17f-98af24a65334-kube-api-access-nzvfb\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.154592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152808    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-etc-sysctl-conf\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.154592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152836    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-cni-bin\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.154592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152526    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/665485ca-0a37-4609-8487-e43115703513-lib-modules\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.154592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152846    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4f84636-68e1-4725-8733-3b652bc4b925-env-overrides\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.154592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152905    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4f84636-68e1-4725-8733-3b652bc4b925-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.154592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152912    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4f84636-68e1-4725-8733-3b652bc4b925-ovnkube-config\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.154592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.152957    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-socket-dir\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.154592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.153010    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e80b9bcd-7737-4ecc-a17f-98af24a65334-sys-fs\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.154592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.153277    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4f84636-68e1-4725-8733-3b652bc4b925-ovnkube-script-lib\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.154592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.154566    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/665485ca-0a37-4609-8487-e43115703513-tmp\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.154975 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.154613    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4f84636-68e1-4725-8733-3b652bc4b925-ovn-node-metrics-cert\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.154975 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.154801    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/665485ca-0a37-4609-8487-e43115703513-etc-tuned\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.157193 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.157178    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:45:58.157256 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.157196    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:45:58.157256 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.157205    2572 projected.go:194] Error preparing data for projected volume kube-api-access-kksdd for pod openshift-network-diagnostics/network-check-target-7mbbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:45:58.157316 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.157267    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd podName:0a9b903e-d81d-46cf-940e-6d3a8832ef61 nodeName:}" failed. No retries permitted until 2026-05-28 18:45:58.657247954 +0000 UTC m=+3.217022901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kksdd" (UniqueName: "kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd") pod "network-check-target-7mbbk" (UID: "0a9b903e-d81d-46cf-940e-6d3a8832ef61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:45:58.159229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.159209    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64chx\" (UniqueName: \"kubernetes.io/projected/665485ca-0a37-4609-8487-e43115703513-kube-api-access-64chx\") pod \"tuned-nqb7t\" (UID: \"665485ca-0a37-4609-8487-e43115703513\") " pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.159570 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.159553    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fbw8\" (UniqueName: \"kubernetes.io/projected/e4f84636-68e1-4725-8733-3b652bc4b925-kube-api-access-7fbw8\") pod \"ovnkube-node-drfnc\" (UID: \"e4f84636-68e1-4725-8733-3b652bc4b925\") " pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.159757 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.159737    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzvfb\" (UniqueName: \"kubernetes.io/projected/e80b9bcd-7737-4ecc-a17f-98af24a65334-kube-api-access-nzvfb\") pod \"aws-ebs-csi-driver-node-r8bng\" (UID: \"e80b9bcd-7737-4ecc-a17f-98af24a65334\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.238008 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.237971    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d8s9c"
May 28 18:45:58.244734 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.244713    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z5b94"
May 28 18:45:58.256473 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.256448    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-skwhx"
May 28 18:45:58.265069 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.265051    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dscsk"
May 28 18:45:58.272607 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.272587    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6lnc4"
May 28 18:45:58.279116 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.279099    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kpd7z"
May 28 18:45:58.286688 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.286672    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nqb7t"
May 28 18:45:58.295286 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.295270    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:45:58.300878 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.300821    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng"
May 28 18:45:58.555656 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.555570    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:45:58.555817 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.555680    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:45:58.555817 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.555740    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs podName:a7cc5970-0522-44ea-b02e-1ff310c0793c nodeName:}" failed. No retries permitted until 2026-05-28 18:45:59.555720082 +0000 UTC m=+4.115495091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs") pod "network-metrics-daemon-shplj" (UID: "a7cc5970-0522-44ea-b02e-1ff310c0793c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:45:58.750812 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.750016    2572 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:45:58.756847 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.756823    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kksdd\" (UniqueName: \"kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd\") pod \"network-check-target-7mbbk\" (UID: \"0a9b903e-d81d-46cf-940e-6d3a8832ef61\") " pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:45:58.756995 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.756978    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:45:58.757040 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.757002    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:45:58.757040 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.757013    2572 projected.go:194] Error preparing data for projected volume kube-api-access-kksdd for pod openshift-network-diagnostics/network-check-target-7mbbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:45:58.757115 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:58.757079    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd podName:0a9b903e-d81d-46cf-940e-6d3a8832ef61 nodeName:}" failed. No retries permitted until 2026-05-28 18:45:59.757061264 +0000 UTC m=+4.316836210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kksdd" (UniqueName: "kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd") pod "network-check-target-7mbbk" (UID: "0a9b903e-d81d-46cf-940e-6d3a8832ef61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:45:58.953919 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:58.953887    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa45763_d22c_499b_a9c8_cd625e9c03cf.slice/crio-8b7d7cad457ee3af9935ae94e2f4210075c9e88ad274ff066333bc7927407e8f WatchSource:0}: Error finding container 8b7d7cad457ee3af9935ae94e2f4210075c9e88ad274ff066333bc7927407e8f: Status 404 returned error can't find the container with id 8b7d7cad457ee3af9935ae94e2f4210075c9e88ad274ff066333bc7927407e8f
May 28 18:45:58.955227 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:58.955183    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a13d797_b325_407d_a167_b39dbe3b2857.slice/crio-a199aa356f368ad29257238d0e45b614ee0b25e97bd93ad3ac4e71ac410d6364 WatchSource:0}: Error finding container a199aa356f368ad29257238d0e45b614ee0b25e97bd93ad3ac4e71ac410d6364: Status 404 returned error can't find the container with id a199aa356f368ad29257238d0e45b614ee0b25e97bd93ad3ac4e71ac410d6364
May 28 18:45:58.956926 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:58.956777    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1e17f8_bf36_455f_b124_a3beefa6850e.slice/crio-3f357de25708c5a17c29e7cc395f3ec12d8439ea94926752d2ce407fc6f14a96 WatchSource:0}: Error finding container 3f357de25708c5a17c29e7cc395f3ec12d8439ea94926752d2ce407fc6f14a96: Status 404 returned error can't find the container with id 3f357de25708c5a17c29e7cc395f3ec12d8439ea94926752d2ce407fc6f14a96
May 28 18:45:58.960037 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:58.960011    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a43270_977b_4b7c_9832_872e8b54fa72.slice/crio-36e4f3fd0933363f150182b6f07037c7ea1c5b01803f989fe5d5c520a10a1b8e WatchSource:0}: Error finding container 36e4f3fd0933363f150182b6f07037c7ea1c5b01803f989fe5d5c520a10a1b8e: Status 404 returned error can't find the container with id 36e4f3fd0933363f150182b6f07037c7ea1c5b01803f989fe5d5c520a10a1b8e
May 28 18:45:58.960963 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:58.960755    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cedd45a_9c5b_4d26_b004_7096a2103638.slice/crio-3605a70fce64b774cbaec0d91ad544d1a59a0bbbf66d5929c6fa433f639baeab WatchSource:0}: Error finding container 3605a70fce64b774cbaec0d91ad544d1a59a0bbbf66d5929c6fa433f639baeab: Status 404 returned error can't find the container with id 3605a70fce64b774cbaec0d91ad544d1a59a0bbbf66d5929c6fa433f639baeab
May 28 18:45:58.962341 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:58.962221    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74161a4_02e9_4d30_869f_f53d4767c576.slice/crio-d525d4f66222a37fe37a60b85ffc9c35989f188c0780c8ae405d0a5e6ebefb1f WatchSource:0}: Error finding container d525d4f66222a37fe37a60b85ffc9c35989f188c0780c8ae405d0a5e6ebefb1f: Status 404 returned error can't find the container with id d525d4f66222a37fe37a60b85ffc9c35989f188c0780c8ae405d0a5e6ebefb1f
May 28 18:45:58.962557 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:58.962516    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f84636_68e1_4725_8733_3b652bc4b925.slice/crio-0eca96a0d2b051f2bf9a0f7372a2373e0af8b43abcf9d5182e966baf0a0f9c4e WatchSource:0}: Error finding container 0eca96a0d2b051f2bf9a0f7372a2373e0af8b43abcf9d5182e966baf0a0f9c4e: Status 404 returned error can't find the container with id 0eca96a0d2b051f2bf9a0f7372a2373e0af8b43abcf9d5182e966baf0a0f9c4e
May 28 18:45:58.963716 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:58.963686    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665485ca_0a37_4609_8487_e43115703513.slice/crio-9248ce2656ad296c42baa78b824ee3e268fb3cd741e500145fc5551ec490e0f6 WatchSource:0}: Error finding container 9248ce2656ad296c42baa78b824ee3e268fb3cd741e500145fc5551ec490e0f6: Status 404 returned error can't find the container with id 9248ce2656ad296c42baa78b824ee3e268fb3cd741e500145fc5551ec490e0f6
May 28 18:45:58.965185 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:45:58.965080    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80b9bcd_7737_4ecc_a17f_98af24a65334.slice/crio-71fd7e1ec0849b565526246b57772f8d31102588747562fb433164c0ac150e2b WatchSource:0}: Error finding container 71fd7e1ec0849b565526246b57772f8d31102588747562fb433164c0ac150e2b: Status 404 returned error can't find the container with id 71fd7e1ec0849b565526246b57772f8d31102588747562fb433164c0ac150e2b
May 28 18:45:58.970439 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.970410    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:40:56 +0000 UTC" deadline="2028-03-07 16:54:44.23124963 +0000 UTC"
May 28 18:45:58.970540 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:58.970440    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15574h8m45.260813291s"
May 28 18:45:59.065429 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.065192    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng" event={"ID":"e80b9bcd-7737-4ecc-a17f-98af24a65334","Type":"ContainerStarted","Data":"71fd7e1ec0849b565526246b57772f8d31102588747562fb433164c0ac150e2b"}
May 28 18:45:59.066344 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.066313    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc" event={"ID":"e4f84636-68e1-4725-8733-3b652bc4b925","Type":"ContainerStarted","Data":"0eca96a0d2b051f2bf9a0f7372a2373e0af8b43abcf9d5182e966baf0a0f9c4e"}
May 28 18:45:59.067411 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.067374    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6lnc4" event={"ID":"f74161a4-02e9-4d30-869f-f53d4767c576","Type":"ContainerStarted","Data":"d525d4f66222a37fe37a60b85ffc9c35989f188c0780c8ae405d0a5e6ebefb1f"}
May 28 18:45:59.068315 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.068290    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d8s9c" event={"ID":"9a1e17f8-bf36-455f-b124-a3beefa6850e","Type":"ContainerStarted","Data":"3f357de25708c5a17c29e7cc395f3ec12d8439ea94926752d2ce407fc6f14a96"}
May 28 18:45:59.069439 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.069414    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z5b94" event={"ID":"2a13d797-b325-407d-a167-b39dbe3b2857","Type":"ContainerStarted","Data":"a199aa356f368ad29257238d0e45b614ee0b25e97bd93ad3ac4e71ac410d6364"}
May 28 18:45:59.070429 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.070409    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-skwhx" event={"ID":"aaa45763-d22c-499b-a9c8-cd625e9c03cf","Type":"ContainerStarted","Data":"8b7d7cad457ee3af9935ae94e2f4210075c9e88ad274ff066333bc7927407e8f"}
May 28 18:45:59.071594 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.071575    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nqb7t" event={"ID":"665485ca-0a37-4609-8487-e43115703513","Type":"ContainerStarted","Data":"9248ce2656ad296c42baa78b824ee3e268fb3cd741e500145fc5551ec490e0f6"}
May 28 18:45:59.072634 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.072616    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpd7z" event={"ID":"7cedd45a-9c5b-4d26-b004-7096a2103638","Type":"ContainerStarted","Data":"3605a70fce64b774cbaec0d91ad544d1a59a0bbbf66d5929c6fa433f639baeab"}
May 28 18:45:59.073624 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.073603    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dscsk" event={"ID":"f7a43270-977b-4b7c-9832-872e8b54fa72","Type":"ContainerStarted","Data":"36e4f3fd0933363f150182b6f07037c7ea1c5b01803f989fe5d5c520a10a1b8e"}
May 28 18:45:59.075057 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.075036    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-108.ec2.internal" event={"ID":"c85ec789d0afbde36d31782bf9a2e069","Type":"ContainerStarted","Data":"c4afe674cd957090df0021bb579bd032dd498bba250435dcb45ea0d72717c8c8"}
May 28 18:45:59.563227 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.563189    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:45:59.563433 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:59.563369    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:45:59.563501 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:59.563448    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs podName:a7cc5970-0522-44ea-b02e-1ff310c0793c nodeName:}" failed. No retries permitted until 2026-05-28 18:46:01.563428178 +0000 UTC m=+6.123203124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs") pod "network-metrics-daemon-shplj" (UID: "a7cc5970-0522-44ea-b02e-1ff310c0793c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:45:59.765086 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:45:59.765050    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kksdd\" (UniqueName: \"kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd\") pod \"network-check-target-7mbbk\" (UID: \"0a9b903e-d81d-46cf-940e-6d3a8832ef61\") " pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:45:59.765256 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:59.765239    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:45:59.765332 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:59.765264    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:45:59.765332 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:59.765277    2572 projected.go:194] Error preparing data for projected volume kube-api-access-kksdd for pod openshift-network-diagnostics/network-check-target-7mbbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:45:59.765445 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:45:59.765340    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd podName:0a9b903e-d81d-46cf-940e-6d3a8832ef61 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:01.765320936 +0000 UTC m=+6.325095900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kksdd" (UniqueName: "kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd") pod "network-check-target-7mbbk" (UID: "0a9b903e-d81d-46cf-940e-6d3a8832ef61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:46:00.057674 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:00.057546    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:00.057674 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:00.057564    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:00.058194 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:00.057670    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:00.058194 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:00.058076    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:00.101759 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:00.101724    2572 generic.go:358] "Generic (PLEG): container finished" podID="17450dcbe864dfc632ba233f9a71ac7f" containerID="e620ed434010d0725c29a444f8309b31745e5269e51b2e1eee6795af9dd20076" exitCode=0
May 28 18:46:00.101930 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:00.101897    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal" event={"ID":"17450dcbe864dfc632ba233f9a71ac7f","Type":"ContainerDied","Data":"e620ed434010d0725c29a444f8309b31745e5269e51b2e1eee6795af9dd20076"}
May 28 18:46:00.116219 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:00.116172    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-108.ec2.internal" podStartSLOduration=3.116154924 podStartE2EDuration="3.116154924s" podCreationTimestamp="2026-05-28 18:45:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:45:59.086087546 +0000 UTC m=+3.645862515" watchObservedRunningTime="2026-05-28 18:46:00.116154924 +0000 UTC m=+4.675929894"
May 28 18:46:01.118765 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:01.118700    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal" event={"ID":"17450dcbe864dfc632ba233f9a71ac7f","Type":"ContainerStarted","Data":"b2d2f3004a0dc68fe908b6322f1c6f8df5a8cc5315d9f72c8707466f7d43ecb0"}
May 28 18:46:01.582444 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:01.581109    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:01.582444 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:01.581287    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:46:01.582444 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:01.581350    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs podName:a7cc5970-0522-44ea-b02e-1ff310c0793c nodeName:}" failed. No retries permitted until 2026-05-28 18:46:05.58133122 +0000 UTC m=+10.141106170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs") pod "network-metrics-daemon-shplj" (UID: "a7cc5970-0522-44ea-b02e-1ff310c0793c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:46:01.782498 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:01.782455    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kksdd\" (UniqueName: \"kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd\") pod \"network-check-target-7mbbk\" (UID: \"0a9b903e-d81d-46cf-940e-6d3a8832ef61\") " pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:01.782679 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:01.782625    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:46:01.782679 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:01.782647    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:46:01.782679 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:01.782660    2572 projected.go:194] Error preparing data for projected volume kube-api-access-kksdd for pod openshift-network-diagnostics/network-check-target-7mbbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:46:01.782842 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:01.782718    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd podName:0a9b903e-d81d-46cf-940e-6d3a8832ef61 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:05.782699955 +0000 UTC m=+10.342474902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kksdd" (UniqueName: "kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd") pod "network-check-target-7mbbk" (UID: "0a9b903e-d81d-46cf-940e-6d3a8832ef61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:46:02.058245 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:02.057530    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:02.058245 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:02.057649    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:02.058245 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:02.058062    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:02.058245 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:02.058156    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:04.056733 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:04.056699    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:04.057181 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:04.056831    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:04.057242 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:04.057205    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:04.057346 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:04.057319    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:05.616313 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:05.615723    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:05.616313 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:05.615919    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:46:05.616313 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:05.615981    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs podName:a7cc5970-0522-44ea-b02e-1ff310c0793c nodeName:}" failed. No retries permitted until 2026-05-28 18:46:13.615962233 +0000 UTC m=+18.175737184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs") pod "network-metrics-daemon-shplj" (UID: "a7cc5970-0522-44ea-b02e-1ff310c0793c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:46:05.818369 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:05.818325    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kksdd\" (UniqueName: \"kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd\") pod \"network-check-target-7mbbk\" (UID: \"0a9b903e-d81d-46cf-940e-6d3a8832ef61\") " pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:05.818568 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:05.818515    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:46:05.818568 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:05.818538    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:46:05.818568 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:05.818550    2572 projected.go:194] Error preparing data for projected volume kube-api-access-kksdd for pod openshift-network-diagnostics/network-check-target-7mbbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:46:05.818733 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:05.818615    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd podName:0a9b903e-d81d-46cf-940e-6d3a8832ef61 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:13.818595314 +0000 UTC m=+18.378370280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kksdd" (UniqueName: "kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd") pod "network-check-target-7mbbk" (UID: "0a9b903e-d81d-46cf-940e-6d3a8832ef61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:46:06.058218 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:06.057608    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:06.058218 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:06.057718    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:06.058218 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:06.058073    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:06.058218 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:06.058174    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:08.056469 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:08.056438    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:08.056940 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:08.056438    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:08.056940 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:08.056580    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:08.056940 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:08.056669    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:10.056556 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:10.056523    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:10.056556 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:10.056552    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:10.057003 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:10.056644    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:10.057003 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:10.056749    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:12.056598 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:12.056553    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:12.057021 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:12.056553    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:12.057021 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:12.056694    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:12.057021 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:12.056775    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:13.676784 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:13.676747    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:13.677217 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:13.676935    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:46:13.677217 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:13.677013    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs podName:a7cc5970-0522-44ea-b02e-1ff310c0793c nodeName:}" failed. No retries permitted until 2026-05-28 18:46:29.67699642 +0000 UTC m=+34.236771385 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs") pod "network-metrics-daemon-shplj" (UID: "a7cc5970-0522-44ea-b02e-1ff310c0793c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:46:13.878124 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:13.878090    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kksdd\" (UniqueName: \"kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd\") pod \"network-check-target-7mbbk\" (UID: \"0a9b903e-d81d-46cf-940e-6d3a8832ef61\") " pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:13.878302 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:13.878281    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:46:13.878359 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:13.878311    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:46:13.878359 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:13.878324    2572 projected.go:194] Error preparing data for projected volume kube-api-access-kksdd for pod openshift-network-diagnostics/network-check-target-7mbbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:46:13.878487 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:13.878407    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd podName:0a9b903e-d81d-46cf-940e-6d3a8832ef61 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:29.878372181 +0000 UTC m=+34.438147150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kksdd" (UniqueName: "kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd") pod "network-check-target-7mbbk" (UID: "0a9b903e-d81d-46cf-940e-6d3a8832ef61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:46:14.056786 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:14.056697    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:14.056940 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:14.056829    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:14.056940 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:14.056898    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:14.057061 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:14.057027    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:16.057475 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:16.057446    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:16.057879 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:16.057527    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:16.057879 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:16.057598    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:16.057879 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:16.057692    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:17.145512 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:17.145479    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dscsk" event={"ID":"f7a43270-977b-4b7c-9832-872e8b54fa72","Type":"ContainerStarted","Data":"70bc5f953b949f31cb01a291e7249df888df615a923f089352293e515680cd23"}
May 28 18:46:17.180401 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:17.180187    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-108.ec2.internal" podStartSLOduration=20.180168396 podStartE2EDuration="20.180168396s" podCreationTimestamp="2026-05-28 18:45:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:46:01.133310979 +0000 UTC m=+5.693085950" watchObservedRunningTime="2026-05-28 18:46:17.180168396 +0000 UTC m=+21.739943364"
May 28 18:46:17.180593 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:17.180547    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dscsk" podStartSLOduration=11.214263584 podStartE2EDuration="21.180534641s" podCreationTimestamp="2026-05-28 18:45:56 +0000 UTC" firstStartedPulling="2026-05-28 18:45:58.962081316 +0000 UTC m=+3.521856276" lastFinishedPulling="2026-05-28 18:46:08.928352368 +0000 UTC m=+13.488127333" observedRunningTime="2026-05-28 18:46:17.179370539 +0000 UTC m=+21.739145508" watchObservedRunningTime="2026-05-28 18:46:17.180534641 +0000 UTC m=+21.740309611"
May 28 18:46:18.057033 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.056730    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:18.057276 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:18.057079    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:18.057487 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.056731    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:18.057636 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:18.057615    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:18.148007 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.147977    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng" event={"ID":"e80b9bcd-7737-4ecc-a17f-98af24a65334","Type":"ContainerStarted","Data":"200ae4ddece14e83a8b3de1d38329b0cb828f014e1df5da7f6f418f4d44cdf50"}
May 28 18:46:18.150266 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.150248    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 18:46:18.150589 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.150566    2572 generic.go:358] "Generic (PLEG): container finished" podID="e4f84636-68e1-4725-8733-3b652bc4b925" containerID="ed1f662b52cc58ac098e90a8e1e03f783e4132bce9f717a523f7d41f8c8eaa22" exitCode=1
May 28 18:46:18.150747 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.150630    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc" event={"ID":"e4f84636-68e1-4725-8733-3b652bc4b925","Type":"ContainerStarted","Data":"426b72b6a5b7b92b4d64c730239458de5a6698a7b9d56a869c15ff44c798adba"}
May 28 18:46:18.150747 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.150657    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc" event={"ID":"e4f84636-68e1-4725-8733-3b652bc4b925","Type":"ContainerStarted","Data":"76bdcc72963ca72ccc430819299548a280fbe59fcaf00ac6f4aead87c08b5dba"}
May 28 18:46:18.150747 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.150665    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc" event={"ID":"e4f84636-68e1-4725-8733-3b652bc4b925","Type":"ContainerStarted","Data":"5551aeb04e2c63889e23af8debd02ecf54e79d78b3735595d33926471f4385e5"}
May 28 18:46:18.150747 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.150674    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc" event={"ID":"e4f84636-68e1-4725-8733-3b652bc4b925","Type":"ContainerStarted","Data":"dcdd5675e7ce5457239ff077100eff452518475ea404f5f243c04000b2f18856"}
May 28 18:46:18.150747 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.150708    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc" event={"ID":"e4f84636-68e1-4725-8733-3b652bc4b925","Type":"ContainerDied","Data":"ed1f662b52cc58ac098e90a8e1e03f783e4132bce9f717a523f7d41f8c8eaa22"}
May 28 18:46:18.150747 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.150718    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc" event={"ID":"e4f84636-68e1-4725-8733-3b652bc4b925","Type":"ContainerStarted","Data":"65cc80e6a66f09ffcdecf71385591ccffa4cdceb2b194d45747f753c906fac0c"}
May 28 18:46:18.151819 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.151798    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6lnc4" event={"ID":"f74161a4-02e9-4d30-869f-f53d4767c576","Type":"ContainerStarted","Data":"f9c57b08b660dda2c5132c6fc52a87b72aaee41e22dda1dabb3fe7873d288863"}
May 28 18:46:18.152909 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.152890    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d8s9c" event={"ID":"9a1e17f8-bf36-455f-b124-a3beefa6850e","Type":"ContainerStarted","Data":"3c5bcb9d69c5299fc9b590c75dc73d3d4253f92972325413ed44ae5ca9bb3777"}
May 28 18:46:18.154029 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.154013    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z5b94" event={"ID":"2a13d797-b325-407d-a167-b39dbe3b2857","Type":"ContainerStarted","Data":"fe2e0bc25695f8a4c6cdb3846701acbfca2a4370fc1df3ab7b6824e8079432cf"}
May 28 18:46:18.158519 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.158488    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nqb7t" event={"ID":"665485ca-0a37-4609-8487-e43115703513","Type":"ContainerStarted","Data":"b5f96b7861c0f83da64967210bde448f5e3faeb53d2f33f513c5ad66c7a6a3e8"}
May 28 18:46:18.159724 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.159702    2572 generic.go:358] "Generic (PLEG): container finished" podID="7cedd45a-9c5b-4d26-b004-7096a2103638" containerID="95107fcaecddfa04526d7c231806095bb64e7abb220231f4b38306591a476986" exitCode=0
May 28 18:46:18.159805 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.159785    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpd7z" event={"ID":"7cedd45a-9c5b-4d26-b004-7096a2103638","Type":"ContainerDied","Data":"95107fcaecddfa04526d7c231806095bb64e7abb220231f4b38306591a476986"}
May 28 18:46:18.166895 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.166859    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-6lnc4" podStartSLOduration=4.161618783 podStartE2EDuration="22.166849347s" podCreationTimestamp="2026-05-28 18:45:56 +0000 UTC" firstStartedPulling="2026-05-28 18:45:58.964315165 +0000 UTC m=+3.524090126" lastFinishedPulling="2026-05-28 18:46:16.96954573 +0000 UTC m=+21.529320690" observedRunningTime="2026-05-28 18:46:18.166590062 +0000 UTC m=+22.726365032" watchObservedRunningTime="2026-05-28 18:46:18.166849347 +0000 UTC m=+22.726624314"
May 28 18:46:18.194416 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.194363    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-d8s9c" podStartSLOduration=4.170123062 podStartE2EDuration="22.194352625s" podCreationTimestamp="2026-05-28 18:45:56 +0000 UTC" firstStartedPulling="2026-05-28 18:45:58.958783768 +0000 UTC m=+3.518558713" lastFinishedPulling="2026-05-28 18:46:16.983013329 +0000 UTC m=+21.542788276" observedRunningTime="2026-05-28 18:46:18.181058534 +0000 UTC m=+22.740833502" watchObservedRunningTime="2026-05-28 18:46:18.194352625 +0000 UTC m=+22.754127593"
May 28 18:46:18.194734 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.194710    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z5b94" podStartSLOduration=4.182117179 podStartE2EDuration="22.194704976s" podCreationTimestamp="2026-05-28 18:45:56 +0000 UTC" firstStartedPulling="2026-05-28 18:45:58.957339298 +0000 UTC m=+3.517114245" lastFinishedPulling="2026-05-28 18:46:16.96992708 +0000 UTC m=+21.529702042" observedRunningTime="2026-05-28 18:46:18.194219179 +0000 UTC m=+22.753994147" watchObservedRunningTime="2026-05-28 18:46:18.194704976 +0000 UTC m=+22.754479941"
May 28 18:46:18.230415 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.230359    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nqb7t" podStartSLOduration=4.224733705 podStartE2EDuration="22.230348334s" podCreationTimestamp="2026-05-28 18:45:56 +0000 UTC" firstStartedPulling="2026-05-28 18:45:58.965713056 +0000 UTC m=+3.525488004" lastFinishedPulling="2026-05-28 18:46:16.97132767 +0000 UTC m=+21.531102633" observedRunningTime="2026-05-28 18:46:18.229174746 +0000 UTC m=+22.788949713" watchObservedRunningTime="2026-05-28 18:46:18.230348334 +0000 UTC m=+22.790123301"
May 28 18:46:18.622061 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:18.622035    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 18:46:19.008683 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:19.008528    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T18:46:18.622055215Z","UUID":"a5b95efc-617f-4e7d-a5cb-f659e95e556b","Handler":null,"Name":"","Endpoint":""}
May 28 18:46:19.010363 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:19.010330    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 18:46:19.010363 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:19.010373    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 18:46:19.164242 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:19.164206    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng" event={"ID":"e80b9bcd-7737-4ecc-a17f-98af24a65334","Type":"ContainerStarted","Data":"793b39e30e2ca81f927ba73ad1c2e15affed6b2d715efe952f34e2aa98c4e806"}
May 28 18:46:19.165907 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:19.165881    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-skwhx" event={"ID":"aaa45763-d22c-499b-a9c8-cd625e9c03cf","Type":"ContainerStarted","Data":"7ef7120d732a20d24584ddc57d18da46e2ad45ff8b6bec00b7b8607812feed6d"}
May 28 18:46:19.167162 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:19.167138    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dscsk"
May 28 18:46:19.167317 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:19.167302    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dscsk"
May 28 18:46:19.180191 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:19.180152    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-skwhx" podStartSLOduration=5.166125193 podStartE2EDuration="23.180139975s" podCreationTimestamp="2026-05-28 18:45:56 +0000 UTC" firstStartedPulling="2026-05-28 18:45:58.955515291 +0000 UTC m=+3.515290240" lastFinishedPulling="2026-05-28 18:46:16.969530069 +0000 UTC m=+21.529305022" observedRunningTime="2026-05-28 18:46:19.179428024 +0000 UTC m=+23.739202990" watchObservedRunningTime="2026-05-28 18:46:19.180139975 +0000 UTC m=+23.739914943"
May 28 18:46:19.254652 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:19.254619    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dscsk"
May 28 18:46:19.255541 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:19.255511    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dscsk"
May 28 18:46:20.056569 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:20.056525    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:20.056721 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:20.056643    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:20.056721 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:20.056675    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:20.056806 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:20.056739    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:20.169398 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:20.169301    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng" event={"ID":"e80b9bcd-7737-4ecc-a17f-98af24a65334","Type":"ContainerStarted","Data":"b20a82741f0eddce311a0668cc3a84028a2c73b582d9ecd5f6126376117decce"}
May 28 18:46:20.171943 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:20.171911    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 18:46:20.172331 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:20.172293    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc" event={"ID":"e4f84636-68e1-4725-8733-3b652bc4b925","Type":"ContainerStarted","Data":"0e6b5c15131dcbbc06da02b95caeb38848020e7cc8719b9ba30afb123ff5b350"}
May 28 18:46:20.184477 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:20.184441    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r8bng" podStartSLOduration=3.557078452 podStartE2EDuration="24.184427606s" podCreationTimestamp="2026-05-28 18:45:56 +0000 UTC" firstStartedPulling="2026-05-28 18:45:58.966680267 +0000 UTC m=+3.526455213" lastFinishedPulling="2026-05-28 18:46:19.594029404 +0000 UTC m=+24.153804367" observedRunningTime="2026-05-28 18:46:20.183734184 +0000 UTC m=+24.743509143" watchObservedRunningTime="2026-05-28 18:46:20.184427606 +0000 UTC m=+24.744202573"
May 28 18:46:22.057173 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:22.056962    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:22.057922 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:22.056962    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:22.057922 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:22.057299    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:22.057922 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:22.057331    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:22.178451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:22.178426    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 18:46:22.178732 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:22.178709    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc" event={"ID":"e4f84636-68e1-4725-8733-3b652bc4b925","Type":"ContainerStarted","Data":"cdc95dfca22d1e8220dc5d53a8569664a56597e81f75338e341c84c1e0f6d9cf"}
May 28 18:46:22.179034 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:22.179002    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:46:22.179125 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:22.179040    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:46:22.179177 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:22.179149    2572 scope.go:117] "RemoveContainer" containerID="ed1f662b52cc58ac098e90a8e1e03f783e4132bce9f717a523f7d41f8c8eaa22"
May 28 18:46:22.198015 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:22.197789    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:46:23.185653 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:23.185620    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 18:46:23.186155 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:23.186062    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc" event={"ID":"e4f84636-68e1-4725-8733-3b652bc4b925","Type":"ContainerStarted","Data":"87060ac040fc5775e4d0e143699cd4e52b1dfb8c476b592c8ccfa34a5e701fe1"}
May 28 18:46:23.186549 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:23.186525    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:46:23.206883 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:23.206849    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:46:23.220410 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:23.219171    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc" podStartSLOduration=9.163018071 podStartE2EDuration="27.219154563s" podCreationTimestamp="2026-05-28 18:45:56 +0000 UTC" firstStartedPulling="2026-05-28 18:45:58.965296651 +0000 UTC m=+3.525071616" lastFinishedPulling="2026-05-28 18:46:17.021433161 +0000 UTC m=+21.581208108" observedRunningTime="2026-05-28 18:46:23.218547281 +0000 UTC m=+27.778322252" watchObservedRunningTime="2026-05-28 18:46:23.219154563 +0000 UTC m=+27.778929531"
May 28 18:46:23.869951 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:23.869528    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-shplj"]
May 28 18:46:23.869951 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:23.869676    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:23.869951 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:23.869797    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:23.872241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:23.872005    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7mbbk"]
May 28 18:46:23.872241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:23.872112    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:23.872241 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:23.872204    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:25.057240 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:25.057203    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:25.057650 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:25.057316    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:25.191950 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:25.191918    2572 generic.go:358] "Generic (PLEG): container finished" podID="7cedd45a-9c5b-4d26-b004-7096a2103638" containerID="9c72ccf457443f677bde87b8108741c421195050589b3a88eb0e3ced3b2647cd" exitCode=0
May 28 18:46:25.192140 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:25.192015    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpd7z" event={"ID":"7cedd45a-9c5b-4d26-b004-7096a2103638","Type":"ContainerDied","Data":"9c72ccf457443f677bde87b8108741c421195050589b3a88eb0e3ced3b2647cd"}
May 28 18:46:26.057314 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:26.057285    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:26.057790 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:26.057377    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:26.195746 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:26.195510    2572 generic.go:358] "Generic (PLEG): container finished" podID="7cedd45a-9c5b-4d26-b004-7096a2103638" containerID="373e14054118ac33c02049c220d3dc08336dada96ef3401acea26b5f6c21ac40" exitCode=0
May 28 18:46:26.195746 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:26.195582    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpd7z" event={"ID":"7cedd45a-9c5b-4d26-b004-7096a2103638","Type":"ContainerDied","Data":"373e14054118ac33c02049c220d3dc08336dada96ef3401acea26b5f6c21ac40"}
May 28 18:46:27.056617 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:27.056593    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:27.056716 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:27.056698    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:27.199870 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:27.199794    2572 generic.go:358] "Generic (PLEG): container finished" podID="7cedd45a-9c5b-4d26-b004-7096a2103638" containerID="9ff30737d7081e48ae38f78d619c4023a170aaa670673c7f5d9408a0bf4d7f0e" exitCode=0
May 28 18:46:27.199870 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:27.199833    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpd7z" event={"ID":"7cedd45a-9c5b-4d26-b004-7096a2103638","Type":"ContainerDied","Data":"9ff30737d7081e48ae38f78d619c4023a170aaa670673c7f5d9408a0bf4d7f0e"}
May 28 18:46:28.057279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:28.057184    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:28.057464 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:28.057320    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7mbbk" podUID="0a9b903e-d81d-46cf-940e-6d3a8832ef61"
May 28 18:46:29.056505 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.056471    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:29.057222 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:29.056612    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:46:29.701293 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.701258    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:29.701463 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:29.701418    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:46:29.701522 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:29.701498    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs podName:a7cc5970-0522-44ea-b02e-1ff310c0793c nodeName:}" failed. No retries permitted until 2026-05-28 18:47:01.701477482 +0000 UTC m=+66.261252444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs") pod "network-metrics-daemon-shplj" (UID: "a7cc5970-0522-44ea-b02e-1ff310c0793c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:46:29.738488 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.738461    2572 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-108.ec2.internal" event="NodeReady"
May 28 18:46:29.738623 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.738617    2572 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 18:46:29.782709 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.782668    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fkrb7"]
May 28 18:46:29.785335 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.785283    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:46:29.785737 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.785715    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4gpqv"]
May 28 18:46:29.787776 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.787753    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 18:46:29.787878 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.787800    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zpgsq\""
May 28 18:46:29.787946 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.787873    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 18:46:29.788003 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.787986    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 18:46:29.788554 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.788525    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:29.790423 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.790404    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 18:46:29.790516 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.790428    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l78mj\""
May 28 18:46:29.790516 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.790452    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 18:46:29.796759 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.794694    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fkrb7"]
May 28 18:46:29.797276 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.796963    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4gpqv"]
May 28 18:46:29.902835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.902788    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnz9v\" (UniqueName: \"kubernetes.io/projected/691e0268-af9e-4a0e-a0e3-59ecd26fa764-kube-api-access-vnz9v\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:29.902999 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.902863    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:46:29.902999 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.902897    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:29.902999 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.902931    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kksdd\" (UniqueName: \"kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd\") pod \"network-check-target-7mbbk\" (UID: \"0a9b903e-d81d-46cf-940e-6d3a8832ef61\") " pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:29.902999 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.902959    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt7mb\" (UniqueName: \"kubernetes.io/projected/f7a086b4-c593-4f6f-ae62-d04002fce0d3-kube-api-access-lt7mb\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:46:29.902999 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.902983    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/691e0268-af9e-4a0e-a0e3-59ecd26fa764-config-volume\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:29.903215 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:29.903003    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/691e0268-af9e-4a0e-a0e3-59ecd26fa764-tmp-dir\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:29.903215 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:29.903047    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:46:29.903215 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:29.903071    2572 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:46:29.903215 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:29.903083    2572 projected.go:194] Error preparing data for projected volume kube-api-access-kksdd for pod openshift-network-diagnostics/network-check-target-7mbbk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:46:29.903215 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:29.903136    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd podName:0a9b903e-d81d-46cf-940e-6d3a8832ef61 nodeName:}" failed. No retries permitted until 2026-05-28 18:47:01.903118767 +0000 UTC m=+66.462893727 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kksdd" (UniqueName: "kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd") pod "network-check-target-7mbbk" (UID: "0a9b903e-d81d-46cf-940e-6d3a8832ef61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:46:30.004216 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.004117    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnz9v\" (UniqueName: \"kubernetes.io/projected/691e0268-af9e-4a0e-a0e3-59ecd26fa764-kube-api-access-vnz9v\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:30.004216 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.004171    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:46:30.004216 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.004195    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:30.004500 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:30.004265    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:46:30.004500 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:30.004267    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:46:30.004500 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:30.004311    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls podName:691e0268-af9e-4a0e-a0e3-59ecd26fa764 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:30.504298011 +0000 UTC m=+35.064072969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls") pod "dns-default-4gpqv" (UID: "691e0268-af9e-4a0e-a0e3-59ecd26fa764") : secret "dns-default-metrics-tls" not found
May 28 18:46:30.004500 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.004324    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lt7mb\" (UniqueName: \"kubernetes.io/projected/f7a086b4-c593-4f6f-ae62-d04002fce0d3-kube-api-access-lt7mb\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:46:30.004500 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.004345    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/691e0268-af9e-4a0e-a0e3-59ecd26fa764-config-volume\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:30.004500 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.004366    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/691e0268-af9e-4a0e-a0e3-59ecd26fa764-tmp-dir\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:30.004500 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:30.004416    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert podName:f7a086b4-c593-4f6f-ae62-d04002fce0d3 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:30.504376155 +0000 UTC m=+35.064151105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert") pod "ingress-canary-fkrb7" (UID: "f7a086b4-c593-4f6f-ae62-d04002fce0d3") : secret "canary-serving-cert" not found
May 28 18:46:30.004799 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.004678    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/691e0268-af9e-4a0e-a0e3-59ecd26fa764-tmp-dir\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:30.004882 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.004863    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/691e0268-af9e-4a0e-a0e3-59ecd26fa764-config-volume\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:30.014598 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.014576    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnz9v\" (UniqueName: \"kubernetes.io/projected/691e0268-af9e-4a0e-a0e3-59ecd26fa764-kube-api-access-vnz9v\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:30.014739 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.014619    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt7mb\" (UniqueName: \"kubernetes.io/projected/f7a086b4-c593-4f6f-ae62-d04002fce0d3-kube-api-access-lt7mb\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:46:30.057223 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.057193    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:46:30.059917 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.059892    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2kstc\""
May 28 18:46:30.059917 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.059908    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 18:46:30.059917 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.059894    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 18:46:30.507664 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.507628    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:46:30.507855 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:30.507689    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:30.507855 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:30.507823    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:46:30.507960 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:30.507869    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:46:30.507960 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:30.507911    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert podName:f7a086b4-c593-4f6f-ae62-d04002fce0d3 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:31.507886359 +0000 UTC m=+36.067661314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert") pod "ingress-canary-fkrb7" (UID: "f7a086b4-c593-4f6f-ae62-d04002fce0d3") : secret "canary-serving-cert" not found
May 28 18:46:30.507960 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:30.507934    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls podName:691e0268-af9e-4a0e-a0e3-59ecd26fa764 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:31.50792502 +0000 UTC m=+36.067699968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls") pod "dns-default-4gpqv" (UID: "691e0268-af9e-4a0e-a0e3-59ecd26fa764") : secret "dns-default-metrics-tls" not found
May 28 18:46:31.056562 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:31.056521    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:46:31.058861 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:31.058830    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 18:46:31.059259 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:31.058869    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-25f4v\""
May 28 18:46:31.516520 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:31.516487    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:46:31.516727 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:31.516530    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:31.516727 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:31.516646    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:46:31.516727 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:31.516649    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:46:31.516727 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:31.516708    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls podName:691e0268-af9e-4a0e-a0e3-59ecd26fa764 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:33.516694249 +0000 UTC m=+38.076469195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls") pod "dns-default-4gpqv" (UID: "691e0268-af9e-4a0e-a0e3-59ecd26fa764") : secret "dns-default-metrics-tls" not found
May 28 18:46:31.516727 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:31.516726    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert podName:f7a086b4-c593-4f6f-ae62-d04002fce0d3 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:33.516717186 +0000 UTC m=+38.076492133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert") pod "ingress-canary-fkrb7" (UID: "f7a086b4-c593-4f6f-ae62-d04002fce0d3") : secret "canary-serving-cert" not found
May 28 18:46:33.533857 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:33.533823    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:46:33.533857 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:33.533864    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:33.534329 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:33.533986    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:46:33.534329 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:33.534004    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:46:33.534329 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:33.534041    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls podName:691e0268-af9e-4a0e-a0e3-59ecd26fa764 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:37.534028049 +0000 UTC m=+42.093803007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls") pod "dns-default-4gpqv" (UID: "691e0268-af9e-4a0e-a0e3-59ecd26fa764") : secret "dns-default-metrics-tls" not found
May 28 18:46:33.534329 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:33.534063    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert podName:f7a086b4-c593-4f6f-ae62-d04002fce0d3 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:37.534046492 +0000 UTC m=+42.093821438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert") pod "ingress-canary-fkrb7" (UID: "f7a086b4-c593-4f6f-ae62-d04002fce0d3") : secret "canary-serving-cert" not found
May 28 18:46:34.216563 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:34.216353    2572 generic.go:358] "Generic (PLEG): container finished" podID="7cedd45a-9c5b-4d26-b004-7096a2103638" containerID="60d2cb5b35767427353aeceea4f4801edc189fad60f7ef0fc347355f0db4e37e" exitCode=0
May 28 18:46:34.216563 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:34.216439    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpd7z" event={"ID":"7cedd45a-9c5b-4d26-b004-7096a2103638","Type":"ContainerDied","Data":"60d2cb5b35767427353aeceea4f4801edc189fad60f7ef0fc347355f0db4e37e"}
May 28 18:46:35.221050 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:35.221018    2572 generic.go:358] "Generic (PLEG): container finished" podID="7cedd45a-9c5b-4d26-b004-7096a2103638" containerID="717ad6eb9a6c0419408e7bfaa6b12155085c6ecd510f5e7edde9f6fd50953816" exitCode=0
May 28 18:46:35.221409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:35.221059    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpd7z" event={"ID":"7cedd45a-9c5b-4d26-b004-7096a2103638","Type":"ContainerDied","Data":"717ad6eb9a6c0419408e7bfaa6b12155085c6ecd510f5e7edde9f6fd50953816"}
May 28 18:46:36.225311 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:36.225281    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kpd7z" event={"ID":"7cedd45a-9c5b-4d26-b004-7096a2103638","Type":"ContainerStarted","Data":"279a32c194cf2311cdfd4a92fee06f5e069ad97eacfd490cead4c342a445418a"}
May 28 18:46:36.245737 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:36.245692    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kpd7z" podStartSLOduration=5.643429886 podStartE2EDuration="40.245677908s" podCreationTimestamp="2026-05-28 18:45:56 +0000 UTC" firstStartedPulling="2026-05-28 18:45:58.963255744 +0000 UTC m=+3.523030704" lastFinishedPulling="2026-05-28 18:46:33.565503777 +0000 UTC m=+38.125278726" observedRunningTime="2026-05-28 18:46:36.245104193 +0000 UTC m=+40.804879161" watchObservedRunningTime="2026-05-28 18:46:36.245677908 +0000 UTC m=+40.805452876"
May 28 18:46:37.564053 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:37.564013    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:46:37.564053 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:37.564058    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:37.564470 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:37.564166    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:46:37.564470 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:37.564221    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls podName:691e0268-af9e-4a0e-a0e3-59ecd26fa764 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:45.564208298 +0000 UTC m=+50.123983243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls") pod "dns-default-4gpqv" (UID: "691e0268-af9e-4a0e-a0e3-59ecd26fa764") : secret "dns-default-metrics-tls" not found
May 28 18:46:37.564470 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:37.564166    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:46:37.564470 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:37.564294    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert podName:f7a086b4-c593-4f6f-ae62-d04002fce0d3 nodeName:}" failed. No retries permitted until 2026-05-28 18:46:45.564282555 +0000 UTC m=+50.124057516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert") pod "ingress-canary-fkrb7" (UID: "f7a086b4-c593-4f6f-ae62-d04002fce0d3") : secret "canary-serving-cert" not found
May 28 18:46:45.614115 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:45.614074    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:46:45.614585 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:45.614126    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:46:45.614585 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:45.614211    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:46:45.614585 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:45.614272    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert podName:f7a086b4-c593-4f6f-ae62-d04002fce0d3 nodeName:}" failed. No retries permitted until 2026-05-28 18:47:01.614256699 +0000 UTC m=+66.174031645 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert") pod "ingress-canary-fkrb7" (UID: "f7a086b4-c593-4f6f-ae62-d04002fce0d3") : secret "canary-serving-cert" not found
May 28 18:46:45.614585 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:45.614216    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:46:45.614585 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:46:45.614341    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls podName:691e0268-af9e-4a0e-a0e3-59ecd26fa764 nodeName:}" failed. No retries permitted until 2026-05-28 18:47:01.61432944 +0000 UTC m=+66.174104399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls") pod "dns-default-4gpqv" (UID: "691e0268-af9e-4a0e-a0e3-59ecd26fa764") : secret "dns-default-metrics-tls" not found
May 28 18:46:55.202629 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:55.202602    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-drfnc"
May 28 18:46:56.759733 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.759695    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-l69q6"]
May 28 18:46:56.763162 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.763146    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l69q6"
May 28 18:46:56.765153 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.765133    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 18:46:56.767807 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.767787    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l69q6"]
May 28 18:46:56.784521 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.784502    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3aaf0568-b48b-4790-8937-095380de3826-original-pull-secret\") pod \"global-pull-secret-syncer-l69q6\" (UID: \"3aaf0568-b48b-4790-8937-095380de3826\") " pod="kube-system/global-pull-secret-syncer-l69q6"
May 28 18:46:56.784621 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.784561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3aaf0568-b48b-4790-8937-095380de3826-dbus\") pod \"global-pull-secret-syncer-l69q6\" (UID: \"3aaf0568-b48b-4790-8937-095380de3826\") " pod="kube-system/global-pull-secret-syncer-l69q6"
May 28 18:46:56.784621 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.784603    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3aaf0568-b48b-4790-8937-095380de3826-kubelet-config\") pod \"global-pull-secret-syncer-l69q6\" (UID: \"3aaf0568-b48b-4790-8937-095380de3826\") " pod="kube-system/global-pull-secret-syncer-l69q6"
May 28 18:46:56.885632 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.885595    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3aaf0568-b48b-4790-8937-095380de3826-original-pull-secret\") pod \"global-pull-secret-syncer-l69q6\" (UID: \"3aaf0568-b48b-4790-8937-095380de3826\") " pod="kube-system/global-pull-secret-syncer-l69q6"
May 28 18:46:56.885800 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.885663    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3aaf0568-b48b-4790-8937-095380de3826-dbus\") pod \"global-pull-secret-syncer-l69q6\" (UID: \"3aaf0568-b48b-4790-8937-095380de3826\") " pod="kube-system/global-pull-secret-syncer-l69q6"
May 28 18:46:56.885800 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.885698    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3aaf0568-b48b-4790-8937-095380de3826-kubelet-config\") pod \"global-pull-secret-syncer-l69q6\" (UID: \"3aaf0568-b48b-4790-8937-095380de3826\") " pod="kube-system/global-pull-secret-syncer-l69q6"
May 28 18:46:56.885800 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.885777    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3aaf0568-b48b-4790-8937-095380de3826-kubelet-config\") pod \"global-pull-secret-syncer-l69q6\" (UID: \"3aaf0568-b48b-4790-8937-095380de3826\") " pod="kube-system/global-pull-secret-syncer-l69q6"
May 28 18:46:56.885957 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.885838    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3aaf0568-b48b-4790-8937-095380de3826-dbus\") pod \"global-pull-secret-syncer-l69q6\" (UID: \"3aaf0568-b48b-4790-8937-095380de3826\") " pod="kube-system/global-pull-secret-syncer-l69q6"
May 28 18:46:56.888591 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:56.888564    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3aaf0568-b48b-4790-8937-095380de3826-original-pull-secret\") pod \"global-pull-secret-syncer-l69q6\" (UID: \"3aaf0568-b48b-4790-8937-095380de3826\") " pod="kube-system/global-pull-secret-syncer-l69q6"
May 28 18:46:57.071378 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:57.071357    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l69q6"
May 28 18:46:57.197880 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:57.197850    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l69q6"]
May 28 18:46:57.201086 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:46:57.201063    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aaf0568_b48b_4790_8937_095380de3826.slice/crio-8c94cc4aed9b006f190c29e2f1c11db35cdde93d8ab241f310eb95881429d690 WatchSource:0}: Error finding container 8c94cc4aed9b006f190c29e2f1c11db35cdde93d8ab241f310eb95881429d690: Status 404 returned error can't find the container with id 8c94cc4aed9b006f190c29e2f1c11db35cdde93d8ab241f310eb95881429d690
May 28 18:46:57.261468 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:46:57.261437    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l69q6" event={"ID":"3aaf0568-b48b-4790-8937-095380de3826","Type":"ContainerStarted","Data":"8c94cc4aed9b006f190c29e2f1c11db35cdde93d8ab241f310eb95881429d690"}
May 28 18:47:01.270922 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:01.270831    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l69q6" event={"ID":"3aaf0568-b48b-4790-8937-095380de3826","Type":"ContainerStarted","Data":"0a01374e959f0a6b1506d13e1090ef3a9c3fc325e81c11c34e973cf2065f2159"}
May 28 18:47:01.284333 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:01.284290    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l69q6" podStartSLOduration=1.5769662 podStartE2EDuration="5.28427591s" podCreationTimestamp="2026-05-28 18:46:56 +0000 UTC" firstStartedPulling="2026-05-28 18:46:57.203090104 +0000 UTC m=+61.762865054" lastFinishedPulling="2026-05-28 18:47:00.910399804 +0000 UTC m=+65.470174764" observedRunningTime="2026-05-28 18:47:01.283583479 +0000 UTC m=+65.843358448" watchObservedRunningTime="2026-05-28 18:47:01.28427591 +0000 UTC m=+65.844050877"
May 28 18:47:01.621738 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:01.621699    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:47:01.621915 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:01.621856    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:47:01.621915 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:01.621890    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:47:01.621915 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:01.621915    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls podName:691e0268-af9e-4a0e-a0e3-59ecd26fa764 nodeName:}" failed. No retries permitted until 2026-05-28 18:47:33.621899222 +0000 UTC m=+98.181674169 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls") pod "dns-default-4gpqv" (UID: "691e0268-af9e-4a0e-a0e3-59ecd26fa764") : secret "dns-default-metrics-tls" not found
May 28 18:47:01.622037 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:01.621968    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:47:01.622037 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:01.622032    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert podName:f7a086b4-c593-4f6f-ae62-d04002fce0d3 nodeName:}" failed. No retries permitted until 2026-05-28 18:47:33.621998477 +0000 UTC m=+98.181773438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert") pod "ingress-canary-fkrb7" (UID: "f7a086b4-c593-4f6f-ae62-d04002fce0d3") : secret "canary-serving-cert" not found
May 28 18:47:01.723117 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:01.723089    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:47:01.725231 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:01.725214    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 18:47:01.733778 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:01.733761    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 18:47:01.733834 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:01.733812    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs podName:a7cc5970-0522-44ea-b02e-1ff310c0793c nodeName:}" failed. No retries permitted until 2026-05-28 18:48:05.733797353 +0000 UTC m=+130.293572312 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs") pod "network-metrics-daemon-shplj" (UID: "a7cc5970-0522-44ea-b02e-1ff310c0793c") : secret "metrics-daemon-secret" not found
May 28 18:47:01.924055 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:01.923972    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kksdd\" (UniqueName: \"kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd\") pod \"network-check-target-7mbbk\" (UID: \"0a9b903e-d81d-46cf-940e-6d3a8832ef61\") " pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:47:01.926168 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:01.926145    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 18:47:01.936645 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:01.936624    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 18:47:01.947226 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:01.947202    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kksdd\" (UniqueName: \"kubernetes.io/projected/0a9b903e-d81d-46cf-940e-6d3a8832ef61-kube-api-access-kksdd\") pod \"network-check-target-7mbbk\" (UID: \"0a9b903e-d81d-46cf-940e-6d3a8832ef61\") " pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:47:02.170864 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:02.170827    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2kstc\""
May 28 18:47:02.178451 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:02.178380    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:47:02.307730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:02.307674    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7mbbk"]
May 28 18:47:02.311768 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:47:02.311740    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9b903e_d81d_46cf_940e_6d3a8832ef61.slice/crio-2ed1b9c53e2b8fa985b294bb9b86fa7648a097565107f12e79f3d9f12e638e0f WatchSource:0}: Error finding container 2ed1b9c53e2b8fa985b294bb9b86fa7648a097565107f12e79f3d9f12e638e0f: Status 404 returned error can't find the container with id 2ed1b9c53e2b8fa985b294bb9b86fa7648a097565107f12e79f3d9f12e638e0f
May 28 18:47:03.282742 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:03.282701    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7mbbk" event={"ID":"0a9b903e-d81d-46cf-940e-6d3a8832ef61","Type":"ContainerStarted","Data":"2ed1b9c53e2b8fa985b294bb9b86fa7648a097565107f12e79f3d9f12e638e0f"}
May 28 18:47:06.290756 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:06.290723    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7mbbk" event={"ID":"0a9b903e-d81d-46cf-940e-6d3a8832ef61","Type":"ContainerStarted","Data":"0fb1aaf401370fe3e3b5f5ab7074e89a30ba5d4ada37ae54f591efedb7f32e4d"}
May 28 18:47:06.291221 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:06.290903    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:47:06.306118 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:06.306075    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7mbbk" podStartSLOduration=67.217558346 podStartE2EDuration="1m10.306061624s" podCreationTimestamp="2026-05-28 18:45:56 +0000 UTC" firstStartedPulling="2026-05-28 18:47:02.313697228 +0000 UTC m=+66.873472180" lastFinishedPulling="2026-05-28 18:47:05.402200512 +0000 UTC m=+69.961975458" observedRunningTime="2026-05-28 18:47:06.305181847 +0000 UTC m=+70.864956832" watchObservedRunningTime="2026-05-28 18:47:06.306061624 +0000 UTC m=+70.865836591"
May 28 18:47:33.631638 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:33.631585    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:47:33.632044 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:33.631652    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:47:33.632044 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:33.631746    2572 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:47:33.632044 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:33.631818    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert podName:f7a086b4-c593-4f6f-ae62-d04002fce0d3 nodeName:}" failed. No retries permitted until 2026-05-28 18:48:37.631804177 +0000 UTC m=+162.191579136 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert") pod "ingress-canary-fkrb7" (UID: "f7a086b4-c593-4f6f-ae62-d04002fce0d3") : secret "canary-serving-cert" not found
May 28 18:47:33.632044 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:33.631749    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:47:33.632044 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:33.631924    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls podName:691e0268-af9e-4a0e-a0e3-59ecd26fa764 nodeName:}" failed. No retries permitted until 2026-05-28 18:48:37.631910432 +0000 UTC m=+162.191685382 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls") pod "dns-default-4gpqv" (UID: "691e0268-af9e-4a0e-a0e3-59ecd26fa764") : secret "dns-default-metrics-tls" not found
May 28 18:47:37.295073 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:37.295036    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7mbbk"
May 28 18:47:55.009752 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.009712    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bf65b588-4dn44"]
May 28 18:47:55.012669 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.012646    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.015067 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.014789    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 28 18:47:55.015067 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.014839    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 28 18:47:55.015067 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.014791    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 28 18:47:55.015067 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.014928    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2jrgz\""
May 28 18:47:55.015067 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.014789    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 28 18:47:55.015358 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.015153    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 18:47:55.015457 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.015443    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 18:47:55.024522 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.024498    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bf65b588-4dn44"]
May 28 18:47:55.069600 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.069570    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.069736 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.069606    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hhvk\" (UniqueName: \"kubernetes.io/projected/d7c2a0b3-a9e0-4fca-8859-68305375a968-kube-api-access-5hhvk\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.069736 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.069641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-default-certificate\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.069736 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.069700    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-stats-auth\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.069736 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.069722    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.170931 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.170892    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hhvk\" (UniqueName: \"kubernetes.io/projected/d7c2a0b3-a9e0-4fca-8859-68305375a968-kube-api-access-5hhvk\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.170931 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.170939    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-default-certificate\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.171162 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.170980    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-stats-auth\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.171162 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.170998    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.171162 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.171034    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.171162 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:55.171113    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:47:55.171162 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:55.171163    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:47:55.671149227 +0000 UTC m=+120.230924173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : secret "router-metrics-certs-default" not found
May 28 18:47:55.171368 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:55.171227    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:47:55.671205024 +0000 UTC m=+120.230979972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : configmap references non-existent config key: service-ca.crt
May 28 18:47:55.173643 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.173619    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-default-certificate\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.173729 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.173619    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-stats-auth\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.178626 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.178604    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hhvk\" (UniqueName: \"kubernetes.io/projected/d7c2a0b3-a9e0-4fca-8859-68305375a968-kube-api-access-5hhvk\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.674461 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.674411    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.674646 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:55.674512    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:55.674646 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:55.674563    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:47:55.674646 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:55.674645    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:47:56.674627498 +0000 UTC m=+121.234402461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : secret "router-metrics-certs-default" not found
May 28 18:47:55.674759 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:55.674660    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:47:56.674653687 +0000 UTC m=+121.234428633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : configmap references non-existent config key: service-ca.crt
May 28 18:47:56.682045 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:56.682012    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:56.682411 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:56.682064    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:56.682411 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:56.682166    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:47:56.682411 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:56.682176    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:47:58.682159377 +0000 UTC m=+123.241934327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : configmap references non-existent config key: service-ca.crt
May 28 18:47:56.682411 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:56.682205    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:47:58.682193665 +0000 UTC m=+123.241968630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : secret "router-metrics-certs-default" not found
May 28 18:47:58.695754 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:58.695700    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:58.696161 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:47:58.695774    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:47:58.696161 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:58.695852    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:47:58.696161 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:58.695874    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:48:02.695856533 +0000 UTC m=+127.255631479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : configmap references non-existent config key: service-ca.crt
May 28 18:47:58.696161 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:47:58.695896    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:48:02.695889741 +0000 UTC m=+127.255664687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : secret "router-metrics-certs-default" not found
May 28 18:48:00.707007 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:00.706980    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6lnc4_f74161a4-02e9-4d30-869f-f53d4767c576/dns-node-resolver/0.log"
May 28 18:48:01.906062 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:01.906034    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z5b94_2a13d797-b325-407d-a167-b39dbe3b2857/node-ca/0.log"
May 28 18:48:02.722993 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:02.722944    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:02.723178 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:02.723014    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:02.723178 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:02.723103    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:48:02.723178 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:02.723124    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:48:10.72310604 +0000 UTC m=+135.282881012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : configmap references non-existent config key: service-ca.crt
May 28 18:48:02.723178 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:02.723147    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:48:10.723140639 +0000 UTC m=+135.282915584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : secret "router-metrics-certs-default" not found
May 28 18:48:03.033337 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:03.033258    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-wdxb5"]
May 28 18:48:03.036234 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:03.036219    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-wdxb5"
May 28 18:48:03.038502 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:03.038482    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 28 18:48:03.038502 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:03.038488    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 28 18:48:03.038958 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:03.038944    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-46mxb\""
May 28 18:48:03.044164 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:03.044141    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-wdxb5"]
May 28 18:48:03.125866 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:03.125826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvwrb\" (UniqueName: \"kubernetes.io/projected/4bb4764a-9cd4-4fd5-a6bb-5a84ae973eba-kube-api-access-mvwrb\") pod \"volume-data-source-validator-5cf8c89d64-wdxb5\" (UID: \"4bb4764a-9cd4-4fd5-a6bb-5a84ae973eba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-wdxb5"
May 28 18:48:03.226584 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:03.226554    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwrb\" (UniqueName: \"kubernetes.io/projected/4bb4764a-9cd4-4fd5-a6bb-5a84ae973eba-kube-api-access-mvwrb\") pod \"volume-data-source-validator-5cf8c89d64-wdxb5\" (UID: \"4bb4764a-9cd4-4fd5-a6bb-5a84ae973eba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-wdxb5"
May 28 18:48:03.233987 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:03.233958    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvwrb\" (UniqueName: \"kubernetes.io/projected/4bb4764a-9cd4-4fd5-a6bb-5a84ae973eba-kube-api-access-mvwrb\") pod \"volume-data-source-validator-5cf8c89d64-wdxb5\" (UID: \"4bb4764a-9cd4-4fd5-a6bb-5a84ae973eba\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-wdxb5"
May 28 18:48:03.345061 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:03.345020    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-wdxb5"
May 28 18:48:03.461159 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:03.461131    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-wdxb5"]
May 28 18:48:03.464427 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:03.464399    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb4764a_9cd4_4fd5_a6bb_5a84ae973eba.slice/crio-0808c22b7142644c53081e52e07dd14c7c9259d2b05b681a3679dd29c826284a WatchSource:0}: Error finding container 0808c22b7142644c53081e52e07dd14c7c9259d2b05b681a3679dd29c826284a: Status 404 returned error can't find the container with id 0808c22b7142644c53081e52e07dd14c7c9259d2b05b681a3679dd29c826284a
May 28 18:48:04.402834 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:04.402799    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-wdxb5" event={"ID":"4bb4764a-9cd4-4fd5-a6bb-5a84ae973eba","Type":"ContainerStarted","Data":"0808c22b7142644c53081e52e07dd14c7c9259d2b05b681a3679dd29c826284a"}
May 28 18:48:05.405751 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.405709    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-wdxb5" event={"ID":"4bb4764a-9cd4-4fd5-a6bb-5a84ae973eba","Type":"ContainerStarted","Data":"2f05428aec956e165055a8e28de835ae608a3a4d3d1626e0a4dd3bee37d26131"}
May 28 18:48:05.419149 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.419103    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-wdxb5" podStartSLOduration=1.05656291 podStartE2EDuration="2.419091247s" podCreationTimestamp="2026-05-28 18:48:03 +0000 UTC" firstStartedPulling="2026-05-28 18:48:03.466645069 +0000 UTC m=+128.026420015" lastFinishedPulling="2026-05-28 18:48:04.829173404 +0000 UTC m=+129.388948352" observedRunningTime="2026-05-28 18:48:05.418413787 +0000 UTC m=+129.978188754" watchObservedRunningTime="2026-05-28 18:48:05.419091247 +0000 UTC m=+129.978866253"
May 28 18:48:05.715247 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.715164    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-87db6449b-n6fww"]
May 28 18:48:05.718129 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.718114    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.720209 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.720170    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 18:48:05.720209 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.720192    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-79vb8\""
May 28 18:48:05.720379 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.720235    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 18:48:05.720379 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.720181    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 18:48:05.724911 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.724888    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 18:48:05.727687 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.727667    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-87db6449b-n6fww"]
May 28 18:48:05.746660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.746634    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:48:05.746768 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:05.746723    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 18:48:05.746816 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:05.746770    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs podName:a7cc5970-0522-44ea-b02e-1ff310c0793c nodeName:}" failed. No retries permitted until 2026-05-28 18:50:07.746756115 +0000 UTC m=+252.306531074 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs") pod "network-metrics-daemon-shplj" (UID: "a7cc5970-0522-44ea-b02e-1ff310c0793c") : secret "metrics-daemon-secret" not found
May 28 18:48:05.847616 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.847569    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-image-registry-private-configuration\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.847616 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.847629    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e91b4cde-bdb6-4781-b6fe-9789f35b167a-ca-trust-extracted\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.847784 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.847646    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-trusted-ca\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.847784 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.847685    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-installation-pull-secrets\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.847784 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.847700    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-bound-sa-token\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.847784 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.847759    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.847903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.847784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-certificates\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.847903 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.847799    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpjrc\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-kube-api-access-rpjrc\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.948363 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.948322    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.948468 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.948371    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-certificates\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.948468 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.948408    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpjrc\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-kube-api-access-rpjrc\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.948468 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.948445    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-image-registry-private-configuration\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.948600 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:05.948481    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:48:05.948600 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:05.948503    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87db6449b-n6fww: secret "image-registry-tls" not found
May 28 18:48:05.948600 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:05.948556    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls podName:e91b4cde-bdb6-4781-b6fe-9789f35b167a nodeName:}" failed. No retries permitted until 2026-05-28 18:48:06.448541774 +0000 UTC m=+131.008316720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls") pod "image-registry-87db6449b-n6fww" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a") : secret "image-registry-tls" not found
May 28 18:48:05.948600 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.948491    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e91b4cde-bdb6-4781-b6fe-9789f35b167a-ca-trust-extracted\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.948803 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.948642    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-trusted-ca\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.948803 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.948709    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-installation-pull-secrets\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.948803 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.948737    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-bound-sa-token\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.948941 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.948846    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e91b4cde-bdb6-4781-b6fe-9789f35b167a-ca-trust-extracted\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.949087 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.949065    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-certificates\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.949750 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.949728    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-trusted-ca\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.951004 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.950977    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-installation-pull-secrets\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.951004 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.951003    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-image-registry-private-configuration\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.956762 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.956733    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-bound-sa-token\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:05.956862 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:05.956846    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpjrc\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-kube-api-access-rpjrc\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:06.452716 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:06.452679    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:06.453101 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:06.452821    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:48:06.453101 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:06.452839    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87db6449b-n6fww: secret "image-registry-tls" not found
May 28 18:48:06.453101 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:06.452902    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls podName:e91b4cde-bdb6-4781-b6fe-9789f35b167a nodeName:}" failed. No retries permitted until 2026-05-28 18:48:07.452886149 +0000 UTC m=+132.012661095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls") pod "image-registry-87db6449b-n6fww" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a") : secret "image-registry-tls" not found
May 28 18:48:07.460166 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:07.460129    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:07.460651 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:07.460301    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:48:07.460651 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:07.460326    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87db6449b-n6fww: secret "image-registry-tls" not found
May 28 18:48:07.460651 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:07.460413    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls podName:e91b4cde-bdb6-4781-b6fe-9789f35b167a nodeName:}" failed. No retries permitted until 2026-05-28 18:48:09.460373948 +0000 UTC m=+134.020148913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls") pod "image-registry-87db6449b-n6fww" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a") : secret "image-registry-tls" not found
May 28 18:48:09.088305 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:09.088268    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-h9hw4"]
May 28 18:48:09.092316 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:09.092302    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-h9hw4"
May 28 18:48:09.094878 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:09.094859    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h4hpq\""
May 28 18:48:09.106128 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:09.106107    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-h9hw4"]
May 28 18:48:09.173899 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:09.173849    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jctsw\" (UniqueName: \"kubernetes.io/projected/7e3c3a54-b897-42c2-982e-f7d8c23c1c39-kube-api-access-jctsw\") pod \"network-check-source-7f44b6dd87-h9hw4\" (UID: \"7e3c3a54-b897-42c2-982e-f7d8c23c1c39\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-h9hw4"
May 28 18:48:09.274638 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:09.274600    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jctsw\" (UniqueName: \"kubernetes.io/projected/7e3c3a54-b897-42c2-982e-f7d8c23c1c39-kube-api-access-jctsw\") pod \"network-check-source-7f44b6dd87-h9hw4\" (UID: \"7e3c3a54-b897-42c2-982e-f7d8c23c1c39\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-h9hw4"
May 28 18:48:09.281972 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:09.281946    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jctsw\" (UniqueName: \"kubernetes.io/projected/7e3c3a54-b897-42c2-982e-f7d8c23c1c39-kube-api-access-jctsw\") pod \"network-check-source-7f44b6dd87-h9hw4\" (UID: \"7e3c3a54-b897-42c2-982e-f7d8c23c1c39\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-h9hw4"
May 28 18:48:09.400444 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:09.400323    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-h9hw4"
May 28 18:48:09.475884 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:09.475855    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:09.475996 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:09.475980    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:48:09.475996 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:09.475991    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87db6449b-n6fww: secret "image-registry-tls" not found
May 28 18:48:09.476065 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:09.476039    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls podName:e91b4cde-bdb6-4781-b6fe-9789f35b167a nodeName:}" failed. No retries permitted until 2026-05-28 18:48:13.476026034 +0000 UTC m=+138.035800993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls") pod "image-registry-87db6449b-n6fww" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a") : secret "image-registry-tls" not found
May 28 18:48:09.513635 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:09.513606    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-h9hw4"]
May 28 18:48:09.516556 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:09.516520    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3c3a54_b897_42c2_982e_f7d8c23c1c39.slice/crio-a01cb32e06b7e3dd833c4fbe07717338c8963bec450031dfc5fbaf857f3d32ff WatchSource:0}: Error finding container a01cb32e06b7e3dd833c4fbe07717338c8963bec450031dfc5fbaf857f3d32ff: Status 404 returned error can't find the container with id a01cb32e06b7e3dd833c4fbe07717338c8963bec450031dfc5fbaf857f3d32ff
May 28 18:48:10.417310 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:10.417271    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-h9hw4" event={"ID":"7e3c3a54-b897-42c2-982e-f7d8c23c1c39","Type":"ContainerStarted","Data":"31b7ebd976261b48a61886ede743e4840576dc93fe43df45713af06a328fac0a"}
May 28 18:48:10.417310 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:10.417317    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-h9hw4" event={"ID":"7e3c3a54-b897-42c2-982e-f7d8c23c1c39","Type":"ContainerStarted","Data":"a01cb32e06b7e3dd833c4fbe07717338c8963bec450031dfc5fbaf857f3d32ff"}
May 28 18:48:10.431907 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:10.431858    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-h9hw4" podStartSLOduration=1.431817557 podStartE2EDuration="1.431817557s" podCreationTimestamp="2026-05-28 18:48:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:48:10.431078169 +0000 UTC m=+134.990853136" watchObservedRunningTime="2026-05-28 18:48:10.431817557 +0000 UTC m=+134.991592527"
May 28 18:48:10.785885 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:10.785801    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:10.785885 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:10.785870    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:10.786054 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:10.785972    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:48:10.786054 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:10.785997    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:48:26.785983319 +0000 UTC m=+151.345758278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : configmap references non-existent config key: service-ca.crt
May 28 18:48:10.786054 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:10.786027    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs podName:d7c2a0b3-a9e0-4fca-8859-68305375a968 nodeName:}" failed. No retries permitted until 2026-05-28 18:48:26.786014654 +0000 UTC m=+151.345789604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs") pod "router-default-bf65b588-4dn44" (UID: "d7c2a0b3-a9e0-4fca-8859-68305375a968") : secret "router-metrics-certs-default" not found
May 28 18:48:12.349797 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.349764    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c5t9b"]
May 28 18:48:12.352431 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.352406    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.354294 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.354272    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 18:48:12.354413 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.354378    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 18:48:12.354588 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.354560    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 18:48:12.354707 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.354692    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 18:48:12.354956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.354942    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9kchc\""
May 28 18:48:12.360020 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.359999    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c5t9b"]
May 28 18:48:12.456982 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.456945    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bmd86"]
May 28 18:48:12.459774 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.459758    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bmd86"
May 28 18:48:12.462092 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.462066    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 28 18:48:12.462204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.462110    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 28 18:48:12.462204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.462066    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 28 18:48:12.462204 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.462070    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 28 18:48:12.462444 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.462414    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-znn4d\""
May 28 18:48:12.468930 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.468909    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bmd86"]
May 28 18:48:12.501231 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.501204    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7835ab43-4329-4f10-be1d-a9201e8e232f-data-volume\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.501341 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.501273    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.501341 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.501303    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7835ab43-4329-4f10-be1d-a9201e8e232f-crio-socket\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.501446 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.501354    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7835ab43-4329-4f10-be1d-a9201e8e232f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.501446 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.501409    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd5m9\" (UniqueName: \"kubernetes.io/projected/7835ab43-4329-4f10-be1d-a9201e8e232f-kube-api-access-qd5m9\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.602611 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.602525    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.602611 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.602578    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qd5m9\" (UniqueName: \"kubernetes.io/projected/7835ab43-4329-4f10-be1d-a9201e8e232f-kube-api-access-qd5m9\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.602802 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:12.602646    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:48:12.602802 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.602670    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ac56751a-9f19-4671-9c79-2ccb57634ec4-signing-key\") pod \"service-ca-67d667c7d-bmd86\" (UID: \"ac56751a-9f19-4671-9c79-2ccb57634ec4\") " pod="openshift-service-ca/service-ca-67d667c7d-bmd86"
May 28 18:48:12.602802 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.602702    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ac56751a-9f19-4671-9c79-2ccb57634ec4-signing-cabundle\") pod \"service-ca-67d667c7d-bmd86\" (UID: \"ac56751a-9f19-4671-9c79-2ccb57634ec4\") " pod="openshift-service-ca/service-ca-67d667c7d-bmd86"
May 28 18:48:12.602802 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:12.602715    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls podName:7835ab43-4329-4f10-be1d-a9201e8e232f nodeName:}" failed. No retries permitted until 2026-05-28 18:48:13.102695192 +0000 UTC m=+137.662470158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c5t9b" (UID: "7835ab43-4329-4f10-be1d-a9201e8e232f") : secret "insights-runtime-extractor-tls" not found
May 28 18:48:12.602802 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.602795    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7835ab43-4329-4f10-be1d-a9201e8e232f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.603003 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.602821    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7835ab43-4329-4f10-be1d-a9201e8e232f-crio-socket\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.603003 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.602871    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7835ab43-4329-4f10-be1d-a9201e8e232f-data-volume\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.603003 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.602900    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvbfb\" (UniqueName: \"kubernetes.io/projected/ac56751a-9f19-4671-9c79-2ccb57634ec4-kube-api-access-pvbfb\") pod \"service-ca-67d667c7d-bmd86\" (UID: \"ac56751a-9f19-4671-9c79-2ccb57634ec4\") " pod="openshift-service-ca/service-ca-67d667c7d-bmd86"
May 28 18:48:12.603003 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.602990    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7835ab43-4329-4f10-be1d-a9201e8e232f-crio-socket\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.603250 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.603230    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7835ab43-4329-4f10-be1d-a9201e8e232f-data-volume\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.603303 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.603256    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7835ab43-4329-4f10-be1d-a9201e8e232f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.611172 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.611146    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd5m9\" (UniqueName: \"kubernetes.io/projected/7835ab43-4329-4f10-be1d-a9201e8e232f-kube-api-access-qd5m9\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:12.703488 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.703450    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvbfb\" (UniqueName: \"kubernetes.io/projected/ac56751a-9f19-4671-9c79-2ccb57634ec4-kube-api-access-pvbfb\") pod \"service-ca-67d667c7d-bmd86\" (UID: \"ac56751a-9f19-4671-9c79-2ccb57634ec4\") " pod="openshift-service-ca/service-ca-67d667c7d-bmd86"
May 28 18:48:12.703664 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.703634    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ac56751a-9f19-4671-9c79-2ccb57634ec4-signing-key\") pod \"service-ca-67d667c7d-bmd86\" (UID: \"ac56751a-9f19-4671-9c79-2ccb57634ec4\") " pod="openshift-service-ca/service-ca-67d667c7d-bmd86"
May 28 18:48:12.703664 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.703662    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ac56751a-9f19-4671-9c79-2ccb57634ec4-signing-cabundle\") pod \"service-ca-67d667c7d-bmd86\" (UID: \"ac56751a-9f19-4671-9c79-2ccb57634ec4\") " pod="openshift-service-ca/service-ca-67d667c7d-bmd86"
May 28 18:48:12.704341 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.704322    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ac56751a-9f19-4671-9c79-2ccb57634ec4-signing-cabundle\") pod \"service-ca-67d667c7d-bmd86\" (UID: \"ac56751a-9f19-4671-9c79-2ccb57634ec4\") " pod="openshift-service-ca/service-ca-67d667c7d-bmd86"
May 28 18:48:12.705866 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.705845    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ac56751a-9f19-4671-9c79-2ccb57634ec4-signing-key\") pod \"service-ca-67d667c7d-bmd86\" (UID: \"ac56751a-9f19-4671-9c79-2ccb57634ec4\") " pod="openshift-service-ca/service-ca-67d667c7d-bmd86"
May 28 18:48:12.710941 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.710920    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvbfb\" (UniqueName: \"kubernetes.io/projected/ac56751a-9f19-4671-9c79-2ccb57634ec4-kube-api-access-pvbfb\") pod \"service-ca-67d667c7d-bmd86\" (UID: \"ac56751a-9f19-4671-9c79-2ccb57634ec4\") " pod="openshift-service-ca/service-ca-67d667c7d-bmd86"
May 28 18:48:12.768499 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.768468    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bmd86"
May 28 18:48:12.883935 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:12.883866    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bmd86"]
May 28 18:48:12.887077 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:12.887054    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac56751a_9f19_4671_9c79_2ccb57634ec4.slice/crio-56095818c497c80e82b87203e37c557fc5b9a802a054c12f289b13109452be49 WatchSource:0}: Error finding container 56095818c497c80e82b87203e37c557fc5b9a802a054c12f289b13109452be49: Status 404 returned error can't find the container with id 56095818c497c80e82b87203e37c557fc5b9a802a054c12f289b13109452be49
May 28 18:48:13.106702 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:13.106664    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:13.106871 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:13.106818    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:48:13.106915 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:13.106903    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls podName:7835ab43-4329-4f10-be1d-a9201e8e232f nodeName:}" failed. No retries permitted until 2026-05-28 18:48:14.106887472 +0000 UTC m=+138.666662422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c5t9b" (UID: "7835ab43-4329-4f10-be1d-a9201e8e232f") : secret "insights-runtime-extractor-tls" not found
May 28 18:48:13.423849 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:13.423813    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bmd86" event={"ID":"ac56751a-9f19-4671-9c79-2ccb57634ec4","Type":"ContainerStarted","Data":"56095818c497c80e82b87203e37c557fc5b9a802a054c12f289b13109452be49"}
May 28 18:48:13.511432 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:13.511376    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:13.511607 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:13.511565    2572 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:48:13.511607 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:13.511587    2572 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87db6449b-n6fww: secret "image-registry-tls" not found
May 28 18:48:13.511689 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:13.511650    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls podName:e91b4cde-bdb6-4781-b6fe-9789f35b167a nodeName:}" failed. No retries permitted until 2026-05-28 18:48:21.51162849 +0000 UTC m=+146.071403453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls") pod "image-registry-87db6449b-n6fww" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a") : secret "image-registry-tls" not found
May 28 18:48:14.116217 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:14.116181    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:14.116404 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:14.116293    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:48:14.116404 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:14.116345    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls podName:7835ab43-4329-4f10-be1d-a9201e8e232f nodeName:}" failed. No retries permitted until 2026-05-28 18:48:16.116332424 +0000 UTC m=+140.676107375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c5t9b" (UID: "7835ab43-4329-4f10-be1d-a9201e8e232f") : secret "insights-runtime-extractor-tls" not found
May 28 18:48:15.430806 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:15.430750    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bmd86" event={"ID":"ac56751a-9f19-4671-9c79-2ccb57634ec4","Type":"ContainerStarted","Data":"e2b30d73a02ec677b9391b4281122df2212e763097cafed71622c9cb8bb426ca"}
May 28 18:48:15.446680 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:15.446627    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-bmd86" podStartSLOduration=1.620822475 podStartE2EDuration="3.446611434s" podCreationTimestamp="2026-05-28 18:48:12 +0000 UTC" firstStartedPulling="2026-05-28 18:48:12.888859229 +0000 UTC m=+137.448634175" lastFinishedPulling="2026-05-28 18:48:14.714648188 +0000 UTC m=+139.274423134" observedRunningTime="2026-05-28 18:48:15.444975218 +0000 UTC m=+140.004750185" watchObservedRunningTime="2026-05-28 18:48:15.446611434 +0000 UTC m=+140.006386402"
May 28 18:48:16.132252 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:16.132212    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:16.132459 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:16.132418    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:48:16.132513 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:16.132502    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls podName:7835ab43-4329-4f10-be1d-a9201e8e232f nodeName:}" failed. No retries permitted until 2026-05-28 18:48:20.132479836 +0000 UTC m=+144.692254784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c5t9b" (UID: "7835ab43-4329-4f10-be1d-a9201e8e232f") : secret "insights-runtime-extractor-tls" not found
May 28 18:48:20.167050 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:20.167006    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:20.167456 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:20.167165    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:48:20.167456 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:20.167233    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls podName:7835ab43-4329-4f10-be1d-a9201e8e232f nodeName:}" failed. No retries permitted until 2026-05-28 18:48:28.167215368 +0000 UTC m=+152.726990331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c5t9b" (UID: "7835ab43-4329-4f10-be1d-a9201e8e232f") : secret "insights-runtime-extractor-tls" not found
May 28 18:48:21.577915 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:21.577862    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:21.580212 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:21.580188    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls\") pod \"image-registry-87db6449b-n6fww\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") " pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:21.626718 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:21.626685    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:21.747130 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:21.747060    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-87db6449b-n6fww"]
May 28 18:48:21.749518 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:21.749486    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91b4cde_bdb6_4781_b6fe_9789f35b167a.slice/crio-952f7abdd281125f2769a79a1ee0136f714359a278a9e1858a5e5802943720ec WatchSource:0}: Error finding container 952f7abdd281125f2769a79a1ee0136f714359a278a9e1858a5e5802943720ec: Status 404 returned error can't find the container with id 952f7abdd281125f2769a79a1ee0136f714359a278a9e1858a5e5802943720ec
May 28 18:48:22.449758 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:22.449719    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87db6449b-n6fww" event={"ID":"e91b4cde-bdb6-4781-b6fe-9789f35b167a","Type":"ContainerStarted","Data":"be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8"}
May 28 18:48:22.449758 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:22.449759    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87db6449b-n6fww" event={"ID":"e91b4cde-bdb6-4781-b6fe-9789f35b167a","Type":"ContainerStarted","Data":"952f7abdd281125f2769a79a1ee0136f714359a278a9e1858a5e5802943720ec"}
May 28 18:48:22.449972 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:22.449846    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:22.469100 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:22.469052    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-87db6449b-n6fww" podStartSLOduration=17.469037534 podStartE2EDuration="17.469037534s" podCreationTimestamp="2026-05-28 18:48:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:48:22.468736778 +0000 UTC m=+147.028511747" watchObservedRunningTime="2026-05-28 18:48:22.469037534 +0000 UTC m=+147.028812501"
May 28 18:48:26.824464 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:26.824425    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:26.824853 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:26.824555    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:26.825159 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:26.825133    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7c2a0b3-a9e0-4fca-8859-68305375a968-service-ca-bundle\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:26.826760 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:26.826742    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7c2a0b3-a9e0-4fca-8859-68305375a968-metrics-certs\") pod \"router-default-bf65b588-4dn44\" (UID: \"d7c2a0b3-a9e0-4fca-8859-68305375a968\") " pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:27.125246 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:27.125163    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2jrgz\""
May 28 18:48:27.133794 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:27.133765    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:27.252637 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:27.252601    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bf65b588-4dn44"]
May 28 18:48:27.256447 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:27.256420    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c2a0b3_a9e0_4fca_8859_68305375a968.slice/crio-6730d0d59b7cf332889294880d34c3f2da5d0aaab73e35148a146eb2316a9077 WatchSource:0}: Error finding container 6730d0d59b7cf332889294880d34c3f2da5d0aaab73e35148a146eb2316a9077: Status 404 returned error can't find the container with id 6730d0d59b7cf332889294880d34c3f2da5d0aaab73e35148a146eb2316a9077
May 28 18:48:27.462708 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:27.462634    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bf65b588-4dn44" event={"ID":"d7c2a0b3-a9e0-4fca-8859-68305375a968","Type":"ContainerStarted","Data":"d0bbe992dd7c434ec82f66517e2f4b8b4417ee8e52ff2f675ce732a379abd308"}
May 28 18:48:27.462708 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:27.462669    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bf65b588-4dn44" event={"ID":"d7c2a0b3-a9e0-4fca-8859-68305375a968","Type":"ContainerStarted","Data":"6730d0d59b7cf332889294880d34c3f2da5d0aaab73e35148a146eb2316a9077"}
May 28 18:48:27.480155 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:27.480113    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-bf65b588-4dn44" podStartSLOduration=33.480098489 podStartE2EDuration="33.480098489s" podCreationTimestamp="2026-05-28 18:47:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:48:27.479317049 +0000 UTC m=+152.039092084" watchObservedRunningTime="2026-05-28 18:48:27.480098489 +0000 UTC m=+152.039873457"
May 28 18:48:28.134015 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:28.133977    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:28.136585 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:28.136561    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:28.236061 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:28.236020    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:28.238310 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:28.238287    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7835ab43-4329-4f10-be1d-a9201e8e232f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c5t9b\" (UID: \"7835ab43-4329-4f10-be1d-a9201e8e232f\") " pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:28.261225 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:28.261199    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c5t9b"
May 28 18:48:28.380125 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:28.380097    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c5t9b"]
May 28 18:48:28.383245 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:28.383224    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7835ab43_4329_4f10_be1d_a9201e8e232f.slice/crio-be9f10aa9e321b430e2e542ba9a3d78e2788325b47a7d2439be9435111db256c WatchSource:0}: Error finding container be9f10aa9e321b430e2e542ba9a3d78e2788325b47a7d2439be9435111db256c: Status 404 returned error can't find the container with id be9f10aa9e321b430e2e542ba9a3d78e2788325b47a7d2439be9435111db256c
May 28 18:48:28.467018 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:28.466982    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5t9b" event={"ID":"7835ab43-4329-4f10-be1d-a9201e8e232f","Type":"ContainerStarted","Data":"3eed38403eff3f8de3a641059ae8fe978addd8ec24d2555c50587ea4ceb6d449"}
May 28 18:48:28.467188 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:28.467027    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5t9b" event={"ID":"7835ab43-4329-4f10-be1d-a9201e8e232f","Type":"ContainerStarted","Data":"be9f10aa9e321b430e2e542ba9a3d78e2788325b47a7d2439be9435111db256c"}
May 28 18:48:28.467188 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:28.467172    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:28.468413 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:28.468351    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bf65b588-4dn44"
May 28 18:48:29.471205 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:29.471118    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5t9b" event={"ID":"7835ab43-4329-4f10-be1d-a9201e8e232f","Type":"ContainerStarted","Data":"049cc7ebe01a16930aee3381dc4416fda7cc6a1771aa0bf13056395b80f5f284"}
May 28 18:48:31.008724 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:31.008693    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-87db6449b-n6fww"]
May 28 18:48:31.479953 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:31.479921    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c5t9b" event={"ID":"7835ab43-4329-4f10-be1d-a9201e8e232f","Type":"ContainerStarted","Data":"b542f339c9247f0689a3369133d6f0d0b8bf138ca9942e849fa572f46a983f92"}
May 28 18:48:31.499921 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:31.499850    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c5t9b" podStartSLOduration=17.474706202 podStartE2EDuration="19.499818431s" podCreationTimestamp="2026-05-28 18:48:12 +0000 UTC" firstStartedPulling="2026-05-28 18:48:28.438132137 +0000 UTC m=+152.997907090" lastFinishedPulling="2026-05-28 18:48:30.463244358 +0000 UTC m=+155.023019319" observedRunningTime="2026-05-28 18:48:31.496972797 +0000 UTC m=+156.056747765" watchObservedRunningTime="2026-05-28 18:48:31.499818431 +0000 UTC m=+156.059593400"
May 28 18:48:32.800488 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:32.800449    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fkrb7" podUID="f7a086b4-c593-4f6f-ae62-d04002fce0d3"
May 28 18:48:32.806607 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:32.806575    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4gpqv" podUID="691e0268-af9e-4a0e-a0e3-59ecd26fa764"
May 28 18:48:33.484515 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:33.484487    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:48:33.484515 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:33.484522    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4gpqv"
May 28 18:48:34.066514 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:34.066474    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-shplj" podUID="a7cc5970-0522-44ea-b02e-1ff310c0793c"
May 28 18:48:34.751512 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.751467    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"]
May 28 18:48:34.754674 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.754657    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.756608 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.756588    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 28 18:48:34.757087 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.757068    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 28 18:48:34.757264 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.757249    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 18:48:34.757346 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.757286    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cgb9b\""
May 28 18:48:34.757346 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.757295    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 18:48:34.758081 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.758054    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 18:48:34.761905 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.761873    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"]
May 28 18:48:34.790353 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.790327    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/010fe337-8c2a-4742-b454-b02db9a81349-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.790481 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.790362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/010fe337-8c2a-4742-b454-b02db9a81349-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.790517 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.790487    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010fe337-8c2a-4742-b454-b02db9a81349-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.790562 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.790523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zln2k\" (UniqueName: \"kubernetes.io/projected/010fe337-8c2a-4742-b454-b02db9a81349-kube-api-access-zln2k\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.891673 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.891633    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zln2k\" (UniqueName: \"kubernetes.io/projected/010fe337-8c2a-4742-b454-b02db9a81349-kube-api-access-zln2k\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.891673 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.891681    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/010fe337-8c2a-4742-b454-b02db9a81349-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.891915 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.891705    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/010fe337-8c2a-4742-b454-b02db9a81349-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.891915 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.891759    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010fe337-8c2a-4742-b454-b02db9a81349-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.892407 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.892371    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/010fe337-8c2a-4742-b454-b02db9a81349-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.894157 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.894137    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/010fe337-8c2a-4742-b454-b02db9a81349-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.894234 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.894136    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/010fe337-8c2a-4742-b454-b02db9a81349-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:34.898698 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:34.898668    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zln2k\" (UniqueName: \"kubernetes.io/projected/010fe337-8c2a-4742-b454-b02db9a81349-kube-api-access-zln2k\") pod \"prometheus-operator-7779bbdd78-w9vqr\" (UID: \"010fe337-8c2a-4742-b454-b02db9a81349\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:35.064825 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:35.064779    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"
May 28 18:48:35.176986 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:35.176953    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr"]
May 28 18:48:35.180027 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:35.179994    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010fe337_8c2a_4742_b454_b02db9a81349.slice/crio-56e63e2c4e13edb067e89dc79afd160cbb3598b9e3cc413af71dbb442097b9c6 WatchSource:0}: Error finding container 56e63e2c4e13edb067e89dc79afd160cbb3598b9e3cc413af71dbb442097b9c6: Status 404 returned error can't find the container with id 56e63e2c4e13edb067e89dc79afd160cbb3598b9e3cc413af71dbb442097b9c6
May 28 18:48:35.489409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:35.489320    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr" event={"ID":"010fe337-8c2a-4742-b454-b02db9a81349","Type":"ContainerStarted","Data":"56e63e2c4e13edb067e89dc79afd160cbb3598b9e3cc413af71dbb442097b9c6"}
May 28 18:48:37.495810 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:37.495772    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr" event={"ID":"010fe337-8c2a-4742-b454-b02db9a81349","Type":"ContainerStarted","Data":"f243d4c4fb21d98dd00461714965d358ff67c23df6010aad7948ae1aecca6c1c"}
May 28 18:48:37.496248 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:37.495830    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr" event={"ID":"010fe337-8c2a-4742-b454-b02db9a81349","Type":"ContainerStarted","Data":"6ae0cf68a6f6d9141296a93a8a60e22c88652ec8cef34eb29a6f32e651142cdb"}
May 28 18:48:37.511232 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:37.511188    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-w9vqr" podStartSLOduration=2.212617008 podStartE2EDuration="3.511176519s" podCreationTimestamp="2026-05-28 18:48:34 +0000 UTC" firstStartedPulling="2026-05-28 18:48:35.182239773 +0000 UTC m=+159.742014719" lastFinishedPulling="2026-05-28 18:48:36.480799284 +0000 UTC m=+161.040574230" observedRunningTime="2026-05-28 18:48:37.510272246 +0000 UTC m=+162.070047224" watchObservedRunningTime="2026-05-28 18:48:37.511176519 +0000 UTC m=+162.070951487"
May 28 18:48:37.711246 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:37.711206    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:48:37.711246 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:37.711246    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:48:37.713548 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:37.713525    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f7a086b4-c593-4f6f-ae62-d04002fce0d3-cert\") pod \"ingress-canary-fkrb7\" (UID: \"f7a086b4-c593-4f6f-ae62-d04002fce0d3\") " pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:48:37.713658 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:37.713532    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/691e0268-af9e-4a0e-a0e3-59ecd26fa764-metrics-tls\") pod \"dns-default-4gpqv\" (UID: \"691e0268-af9e-4a0e-a0e3-59ecd26fa764\") " pod="openshift-dns/dns-default-4gpqv"
May 28 18:48:37.987811 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:37.987773    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l78mj\""
May 28 18:48:37.988254 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:37.988235    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zpgsq\""
May 28 18:48:37.996751 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:37.996731    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4gpqv"
May 28 18:48:37.996891 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:37.996872    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fkrb7"
May 28 18:48:38.126748 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:38.126710    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fkrb7"]
May 28 18:48:38.130207 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:38.130173    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a086b4_c593_4f6f_ae62_d04002fce0d3.slice/crio-84a7c23d81b19e6a9ca84c5ce4394d8422754167c60d5f6a6ed5aa4c8f278f10 WatchSource:0}: Error finding container 84a7c23d81b19e6a9ca84c5ce4394d8422754167c60d5f6a6ed5aa4c8f278f10: Status 404 returned error can't find the container with id 84a7c23d81b19e6a9ca84c5ce4394d8422754167c60d5f6a6ed5aa4c8f278f10
May 28 18:48:38.144900 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:38.144875    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4gpqv"]
May 28 18:48:38.147622 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:38.147595    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691e0268_af9e_4a0e_a0e3_59ecd26fa764.slice/crio-8e4d38495709bec871a8c3dedff2c5dbe899d9df174dfcb6aac8e2c6bef7bd4b WatchSource:0}: Error finding container 8e4d38495709bec871a8c3dedff2c5dbe899d9df174dfcb6aac8e2c6bef7bd4b: Status 404 returned error can't find the container with id 8e4d38495709bec871a8c3dedff2c5dbe899d9df174dfcb6aac8e2c6bef7bd4b
May 28 18:48:38.499214 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:38.499182    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4gpqv" event={"ID":"691e0268-af9e-4a0e-a0e3-59ecd26fa764","Type":"ContainerStarted","Data":"8e4d38495709bec871a8c3dedff2c5dbe899d9df174dfcb6aac8e2c6bef7bd4b"}
May 28 18:48:38.500169 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:38.500131    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fkrb7" event={"ID":"f7a086b4-c593-4f6f-ae62-d04002fce0d3","Type":"ContainerStarted","Data":"84a7c23d81b19e6a9ca84c5ce4394d8422754167c60d5f6a6ed5aa4c8f278f10"}
May 28 18:48:39.102632 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.102596    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"]
May 28 18:48:39.105883 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.105853    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.107771 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.107741    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 28 18:48:39.108085 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.108066    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6wkl6\""
May 28 18:48:39.108267 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.108252    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 28 18:48:39.112850 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.112826    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"]
May 28 18:48:39.117280 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.116832    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.117430 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.117409    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"]
May 28 18:48:39.119088 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.118789    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 18:48:39.119088 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.118866    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 18:48:39.119088 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.118942    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 18:48:39.119088 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.119002    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fgwx7\""
May 28 18:48:39.129794 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.129748    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"]
May 28 18:48:39.156507 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.156464    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cjdv5"]
May 28 18:48:39.159512 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.159492    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.162915 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.162740    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 18:48:39.164184 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.164017    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 18:48:39.164322 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.164263    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 18:48:39.164732 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.164613    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w4rs5\""
May 28 18:48:39.226424 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226163    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-accelerators-collector-config\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.226424 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226212    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w48j4\" (UniqueName: \"kubernetes.io/projected/e9208269-fa63-4699-a455-c591fdfb0166-kube-api-access-w48j4\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.226424 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226261    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9208269-fa63-4699-a455-c591fdfb0166-root\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.226424 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226315    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jjpx\" (UniqueName: \"kubernetes.io/projected/517c1c75-b4da-42d5-9166-3e43ff083499-kube-api-access-9jjpx\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.226723 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226425    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.226723 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226479    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.226723 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226509    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/517c1c75-b4da-42d5-9166-3e43ff083499-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.226723 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226536    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-textfile\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.226723 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226566    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-tls\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.226723 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226605    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/517c1c75-b4da-42d5-9166-3e43ff083499-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.226723 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226646    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.226723 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226668    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-wtmp\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.227117 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226769    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.227117 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226824    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/517c1c75-b4da-42d5-9166-3e43ff083499-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.227117 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226874    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.227117 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226911    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9208269-fa63-4699-a455-c591fdfb0166-sys\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.227117 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226943    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n86w4\" (UniqueName: \"kubernetes.io/projected/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-api-access-n86w4\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.227117 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.226973    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.227117 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.227007    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9208269-fa63-4699-a455-c591fdfb0166-metrics-client-ca\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.327746 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.327706    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n86w4\" (UniqueName: \"kubernetes.io/projected/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-api-access-n86w4\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.327920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.327759    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.327920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.327792    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9208269-fa63-4699-a455-c591fdfb0166-metrics-client-ca\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.327920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.327866    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-accelerators-collector-config\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.327920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.327906    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w48j4\" (UniqueName: \"kubernetes.io/projected/e9208269-fa63-4699-a455-c591fdfb0166-kube-api-access-w48j4\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.327920 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:39.327911    2572 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 28 18:48:39.328210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.327933    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9208269-fa63-4699-a455-c591fdfb0166-root\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.328210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.327988    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jjpx\" (UniqueName: \"kubernetes.io/projected/517c1c75-b4da-42d5-9166-3e43ff083499-kube-api-access-9jjpx\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.328210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328011    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.328210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328036    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.328210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328063    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/517c1c75-b4da-42d5-9166-3e43ff083499-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.328210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328090    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-textfile\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.328210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328116    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-tls\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.328210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328154    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/517c1c75-b4da-42d5-9166-3e43ff083499-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.328210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328198    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.328676 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328224    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-wtmp\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.328676 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328265    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.328676 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328293    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/517c1c75-b4da-42d5-9166-3e43ff083499-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.328676 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328327    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9208269-fa63-4699-a455-c591fdfb0166-metrics-client-ca\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.328676 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328629    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-textfile\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.328676 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:39.328664    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 28 18:48:39.328930 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328695    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e9208269-fa63-4699-a455-c591fdfb0166-root\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.328930 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:39.328714    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-tls podName:e9208269-fa63-4699-a455-c591fdfb0166 nodeName:}" failed. No retries permitted until 2026-05-28 18:48:39.828695058 +0000 UTC m=+164.388470018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-tls") pod "node-exporter-cjdv5" (UID: "e9208269-fa63-4699-a455-c591fdfb0166") : secret "node-exporter-tls" not found
May 28 18:48:39.328930 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:39.328732    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-tls podName:d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd nodeName:}" failed. No retries permitted until 2026-05-28 18:48:39.828722282 +0000 UTC m=+164.388497234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-pb9xs" (UID: "d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd") : secret "kube-state-metrics-tls" not found
May 28 18:48:39.328930 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328776    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-accelerators-collector-config\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.328930 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328329    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.328930 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328827    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9208269-fa63-4699-a455-c591fdfb0166-sys\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.328930 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.328909    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9208269-fa63-4699-a455-c591fdfb0166-sys\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.330126 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.329501    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.330126 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.329788    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.330126 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.329898    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.330126 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.329938    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-wtmp\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.330126 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:39.329988    2572 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 28 18:48:39.330126 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:39.330036    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517c1c75-b4da-42d5-9166-3e43ff083499-openshift-state-metrics-tls podName:517c1c75-b4da-42d5-9166-3e43ff083499 nodeName:}" failed. No retries permitted until 2026-05-28 18:48:39.830018011 +0000 UTC m=+164.389792976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/517c1c75-b4da-42d5-9166-3e43ff083499-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-ffjks" (UID: "517c1c75-b4da-42d5-9166-3e43ff083499") : secret "openshift-state-metrics-tls" not found
May 28 18:48:39.330126 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.330092    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/517c1c75-b4da-42d5-9166-3e43ff083499-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.332021 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.331976    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/517c1c75-b4da-42d5-9166-3e43ff083499-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.333016 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.332989    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.334000 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.333953    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.342944 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.342418    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n86w4\" (UniqueName: \"kubernetes.io/projected/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-api-access-n86w4\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.342944 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.342902    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jjpx\" (UniqueName: \"kubernetes.io/projected/517c1c75-b4da-42d5-9166-3e43ff083499-kube-api-access-9jjpx\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.344894 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.344854    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w48j4\" (UniqueName: \"kubernetes.io/projected/e9208269-fa63-4699-a455-c591fdfb0166-kube-api-access-w48j4\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.834430 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.834372    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:39.834986 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.834498    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/517c1c75-b4da-42d5-9166-3e43ff083499-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.834986 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.834524    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-tls\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:39.834986 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:39.834659    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 28 18:48:39.834986 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:39.834724    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-tls podName:e9208269-fa63-4699-a455-c591fdfb0166 nodeName:}" failed. No retries permitted until 2026-05-28 18:48:40.834703328 +0000 UTC m=+165.394478274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-tls") pod "node-exporter-cjdv5" (UID: "e9208269-fa63-4699-a455-c591fdfb0166") : secret "node-exporter-tls" not found
May 28 18:48:39.837462 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.837435    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/517c1c75-b4da-42d5-9166-3e43ff083499-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-ffjks\" (UID: \"517c1c75-b4da-42d5-9166-3e43ff083499\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:39.837591 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:39.837513    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-pb9xs\" (UID: \"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:40.020322 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.020282    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"
May 28 18:48:40.033235 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.033198    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"
May 28 18:48:40.190637 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.189654    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.199958    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.202635    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.204614    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.204879    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.204979    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-twssl\""
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.205103    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.205284    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.205425    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.205508    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.205709    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.205906    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 18:48:40.206409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.206106    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.239877    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.239923    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.239970    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.240010    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.240033    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-web-config\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.240073    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.240109    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vnct\" (UniqueName: \"kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-kube-api-access-7vnct\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.240143    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.240166    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.240194    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.240244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.240280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-out\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.248483 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.240325    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.329565 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.329328    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-ffjks"]
May 28 18:48:40.334045 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:40.334009    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517c1c75_b4da_42d5_9166_3e43ff083499.slice/crio-c8c61f07417620be2ed3ef708b584c6fa8fed955e2bdf1948cd069b8483fcb45 WatchSource:0}: Error finding container c8c61f07417620be2ed3ef708b584c6fa8fed955e2bdf1948cd069b8483fcb45: Status 404 returned error can't find the container with id c8c61f07417620be2ed3ef708b584c6fa8fed955e2bdf1948cd069b8483fcb45
May 28 18:48:40.342776 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.342750    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-out\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.343180 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.342811    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.343180 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.342850    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.343180 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.342880    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.343180 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.342920    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.343180 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.342962    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.343180 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.342988    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-web-config\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.343180 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.343036    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.343920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.343895    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.344001 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.343954    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vnct\" (UniqueName: \"kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-kube-api-access-7vnct\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.344001 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.343993    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.344111 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.344019    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.344111 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.344051    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.344111 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.344095    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.344260 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.344115    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.344260 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:40.344222    2572 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 28 18:48:40.344360 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:40.344274    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-main-tls podName:619d4b59-07f7-433e-b3c9-a1bed870f6fa nodeName:}" failed. No retries permitted until 2026-05-28 18:48:40.844254925 +0000 UTC m=+165.404029889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa") : secret "alertmanager-main-tls" not found
May 28 18:48:40.344464 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.344418    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.353718 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.352515    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs"]
May 28 18:48:40.353718 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.353427    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.354402 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.354365    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.361400 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.360733    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-out\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.361400 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.360884    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-volume\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.361400 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.361166    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-web-config\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.361400 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.361255    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.361712 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.361656    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.361875 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.361827    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vnct\" (UniqueName: \"kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-kube-api-access-7vnct\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.364631 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.364607    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.367675 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:40.366284    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd415d6c4_0bf0_4ece_93fa_852cf9b3c8cd.slice/crio-1ca1bd9eb8fa97b76e3c6ca1a3ea54c87f2918a5210157fbd4bb42458bd8f11c WatchSource:0}: Error finding container 1ca1bd9eb8fa97b76e3c6ca1a3ea54c87f2918a5210157fbd4bb42458bd8f11c: Status 404 returned error can't find the container with id 1ca1bd9eb8fa97b76e3c6ca1a3ea54c87f2918a5210157fbd4bb42458bd8f11c
May 28 18:48:40.508343 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.508312    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks" event={"ID":"517c1c75-b4da-42d5-9166-3e43ff083499","Type":"ContainerStarted","Data":"09f7b3d641bb038d20f33c65b29f2651f1562f988934088b120722989b6b9c09"}
May 28 18:48:40.508472 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.508352    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks" event={"ID":"517c1c75-b4da-42d5-9166-3e43ff083499","Type":"ContainerStarted","Data":"c8c61f07417620be2ed3ef708b584c6fa8fed955e2bdf1948cd069b8483fcb45"}
May 28 18:48:40.509532 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.509501    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fkrb7" event={"ID":"f7a086b4-c593-4f6f-ae62-d04002fce0d3","Type":"ContainerStarted","Data":"f89f3068f711edb4807a09bcedb3eaa0d53dbef7890237c58ed7fffe0bdb8011"}
May 28 18:48:40.511077 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.511058    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4gpqv" event={"ID":"691e0268-af9e-4a0e-a0e3-59ecd26fa764","Type":"ContainerStarted","Data":"93a6b49e110c3984bed03e0c59ae74c11b2dcc7cefa65b42d85ac4b51e6cca98"}
May 28 18:48:40.511168 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.511084    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4gpqv" event={"ID":"691e0268-af9e-4a0e-a0e3-59ecd26fa764","Type":"ContainerStarted","Data":"91a0fe06675f7fd1fdff5b476ecd1f9f26ff5e9827eda13477dda8ed497d48d0"}
May 28 18:48:40.511224 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.511197    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4gpqv"
May 28 18:48:40.512176 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.512156    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs" event={"ID":"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd","Type":"ContainerStarted","Data":"1ca1bd9eb8fa97b76e3c6ca1a3ea54c87f2918a5210157fbd4bb42458bd8f11c"}
May 28 18:48:40.523119 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.523069    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fkrb7" podStartSLOduration=129.491708632 podStartE2EDuration="2m11.523054281s" podCreationTimestamp="2026-05-28 18:46:29 +0000 UTC" firstStartedPulling="2026-05-28 18:48:38.13226541 +0000 UTC m=+162.692040355" lastFinishedPulling="2026-05-28 18:48:40.163611049 +0000 UTC m=+164.723386004" observedRunningTime="2026-05-28 18:48:40.522808896 +0000 UTC m=+165.082583857" watchObservedRunningTime="2026-05-28 18:48:40.523054281 +0000 UTC m=+165.082829247"
May 28 18:48:40.537012 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.536967    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4gpqv" podStartSLOduration=129.531329636 podStartE2EDuration="2m11.536952937s" podCreationTimestamp="2026-05-28 18:46:29 +0000 UTC" firstStartedPulling="2026-05-28 18:48:38.149407603 +0000 UTC m=+162.709182550" lastFinishedPulling="2026-05-28 18:48:40.155030898 +0000 UTC m=+164.714805851" observedRunningTime="2026-05-28 18:48:40.536325127 +0000 UTC m=+165.096100095" watchObservedRunningTime="2026-05-28 18:48:40.536952937 +0000 UTC m=+165.096727904"
May 28 18:48:40.849668 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.849627    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-tls\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:40.850120 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.849693    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.852344 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.852317    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:40.852496 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.852342    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e9208269-fa63-4699-a455-c591fdfb0166-node-exporter-tls\") pod \"node-exporter-cjdv5\" (UID: \"e9208269-fa63-4699-a455-c591fdfb0166\") " pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:40.976564 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:40.976525    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cjdv5"
May 28 18:48:40.987449 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:40.987417    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9208269_fa63_4699_a455_c591fdfb0166.slice/crio-9db4675bfd88b4905f1a6191487f432fdce6ae460b44c8d7d2b1dcd44ce93be7 WatchSource:0}: Error finding container 9db4675bfd88b4905f1a6191487f432fdce6ae460b44c8d7d2b1dcd44ce93be7: Status 404 returned error can't find the container with id 9db4675bfd88b4905f1a6191487f432fdce6ae460b44c8d7d2b1dcd44ce93be7
May 28 18:48:41.015104 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.015059    2572 patch_prober.go:28] interesting pod/image-registry-87db6449b-n6fww container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 28 18:48:41.015236 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.015121    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-87db6449b-n6fww" podUID="e91b4cde-bdb6-4781-b6fe-9789f35b167a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 18:48:41.107601 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.107519    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"]
May 28 18:48:41.111439 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.111416    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.114177 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.113760    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 28 18:48:41.114177 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.113863    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-q85b8\""
May 28 18:48:41.114177 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.113897    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3dtkef8g2na90\""
May 28 18:48:41.114177 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.114011    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 28 18:48:41.114177 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.114097    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 28 18:48:41.114177 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.114115    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 28 18:48:41.114678 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.114198    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 28 18:48:41.121028 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.120986    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"]
May 28 18:48:41.141695 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.141667    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 18:48:41.151977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.151838    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.151977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.151886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6cf9a92-4f1d-4d08-bd93-b8205def7461-metrics-client-ca\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.151977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.151924    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.152194 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.151993    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.152194 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.152029    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x48c\" (UniqueName: \"kubernetes.io/projected/f6cf9a92-4f1d-4d08-bd93-b8205def7461-kube-api-access-4x48c\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.152194 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.152119    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.152194 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.152151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-grpc-tls\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.152194 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.152178    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-tls\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.257287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.256184    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.257287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.256239    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-grpc-tls\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.257287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.256268    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-tls\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.257287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.256312    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.257287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.256344    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6cf9a92-4f1d-4d08-bd93-b8205def7461-metrics-client-ca\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.257287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.256378    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.257287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.256447    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.257287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.256485    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4x48c\" (UniqueName: \"kubernetes.io/projected/f6cf9a92-4f1d-4d08-bd93-b8205def7461-kube-api-access-4x48c\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.259002 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.258951    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6cf9a92-4f1d-4d08-bd93-b8205def7461-metrics-client-ca\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.262726 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.262696    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.262848 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.262696    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.262848 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.262822    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.263242 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.263219    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-grpc-tls\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.264173 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.264129    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.264799 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.264754    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f6cf9a92-4f1d-4d08-bd93-b8205def7461-secret-thanos-querier-tls\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.265639 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.265599    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x48c\" (UniqueName: \"kubernetes.io/projected/f6cf9a92-4f1d-4d08-bd93-b8205def7461-kube-api-access-4x48c\") pod \"thanos-querier-57fc9f6dcf-krbhf\" (UID: \"f6cf9a92-4f1d-4d08-bd93-b8205def7461\") " pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.293938 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.293527    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 18:48:41.425447 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.425349    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:41.516778 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.516724    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cjdv5" event={"ID":"e9208269-fa63-4699-a455-c591fdfb0166","Type":"ContainerStarted","Data":"9db4675bfd88b4905f1a6191487f432fdce6ae460b44c8d7d2b1dcd44ce93be7"}
May 28 18:48:41.517938 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:41.517907    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod619d4b59_07f7_433e_b3c9_a1bed870f6fa.slice/crio-afaf8fde41d4c23d52e313675c219ca1a2911b47c916797eb06d8ba07ef015de WatchSource:0}: Error finding container afaf8fde41d4c23d52e313675c219ca1a2911b47c916797eb06d8ba07ef015de: Status 404 returned error can't find the container with id afaf8fde41d4c23d52e313675c219ca1a2911b47c916797eb06d8ba07ef015de
May 28 18:48:41.518538 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.518508    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks" event={"ID":"517c1c75-b4da-42d5-9166-3e43ff083499","Type":"ContainerStarted","Data":"ee37e3e84ef8825a894382c6d2d52050ecfbb3cb724b44c535fe4846ec8226fa"}
May 28 18:48:41.937541 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:41.937504    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"]
May 28 18:48:42.144533 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:42.144117    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6cf9a92_4f1d_4d08_bd93_b8205def7461.slice/crio-5eecfccda9da09b6a6df6a0298119bae16e7aa3ea923a649769fcf870fe5ebac WatchSource:0}: Error finding container 5eecfccda9da09b6a6df6a0298119bae16e7aa3ea923a649769fcf870fe5ebac: Status 404 returned error can't find the container with id 5eecfccda9da09b6a6df6a0298119bae16e7aa3ea923a649769fcf870fe5ebac
May 28 18:48:42.523887 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:42.523843    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks" event={"ID":"517c1c75-b4da-42d5-9166-3e43ff083499","Type":"ContainerStarted","Data":"9cabd7af1419a13fce4266cc2002a68656935f4b5f07500b60f16a4cb57d43ed"}
May 28 18:48:42.524982 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:42.524956    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf" event={"ID":"f6cf9a92-4f1d-4d08-bd93-b8205def7461","Type":"ContainerStarted","Data":"5eecfccda9da09b6a6df6a0298119bae16e7aa3ea923a649769fcf870fe5ebac"}
May 28 18:48:42.525964 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:42.525927    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerStarted","Data":"afaf8fde41d4c23d52e313675c219ca1a2911b47c916797eb06d8ba07ef015de"}
May 28 18:48:42.527806 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:42.527772    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs" event={"ID":"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd","Type":"ContainerStarted","Data":"a91a5d0e5a4a857f6829a6316c8bdaf6c9ebc811ba1fb8db2a1cf6ce4de8bfdf"}
May 28 18:48:42.527806 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:42.527803    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs" event={"ID":"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd","Type":"ContainerStarted","Data":"3c7c27e5c1186c3e8ce886d8e2f517553caa2ab1e43b4362afc4d66389975375"}
May 28 18:48:42.528006 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:42.527817    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs" event={"ID":"d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd","Type":"ContainerStarted","Data":"23b1b099a1b4e1e84f597fefd3c1631e256d01678511a03d2c539b40c36015e3"}
May 28 18:48:42.529166 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:42.529142    2572 generic.go:358] "Generic (PLEG): container finished" podID="e9208269-fa63-4699-a455-c591fdfb0166" containerID="af624760bd53defe33f2d15574e8095e19af211c45b5fe797de5669236d637c1" exitCode=0
May 28 18:48:42.529244 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:42.529186    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cjdv5" event={"ID":"e9208269-fa63-4699-a455-c591fdfb0166","Type":"ContainerDied","Data":"af624760bd53defe33f2d15574e8095e19af211c45b5fe797de5669236d637c1"}
May 28 18:48:42.545119 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:42.545078    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-ffjks" podStartSLOduration=2.256472011 podStartE2EDuration="3.545063139s" podCreationTimestamp="2026-05-28 18:48:39 +0000 UTC" firstStartedPulling="2026-05-28 18:48:40.510408654 +0000 UTC m=+165.070183600" lastFinishedPulling="2026-05-28 18:48:41.798999763 +0000 UTC m=+166.358774728" observedRunningTime="2026-05-28 18:48:42.543652875 +0000 UTC m=+167.103427844" watchObservedRunningTime="2026-05-28 18:48:42.545063139 +0000 UTC m=+167.104838107"
May 28 18:48:42.559776 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:42.559226    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-pb9xs" podStartSLOduration=2.132187738 podStartE2EDuration="3.559211667s" podCreationTimestamp="2026-05-28 18:48:39 +0000 UTC" firstStartedPulling="2026-05-28 18:48:40.370173063 +0000 UTC m=+164.929948021" lastFinishedPulling="2026-05-28 18:48:41.797196987 +0000 UTC m=+166.356971950" observedRunningTime="2026-05-28 18:48:42.559066972 +0000 UTC m=+167.118841940" watchObservedRunningTime="2026-05-28 18:48:42.559211667 +0000 UTC m=+167.118986636"
May 28 18:48:43.461876 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.461842    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-99c984dfb-469xj"]
May 28 18:48:43.465537 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.465504    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.468276 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.468246    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 18:48:43.469076 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.468922    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 18:48:43.469076 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.468946    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tdtbf\""
May 28 18:48:43.469076 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.468961    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 18:48:43.469076 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.468982    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 18:48:43.469076 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.469031    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 18:48:43.469076 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.468981    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 18:48:43.469463 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.469309    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 18:48:43.474105 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.473923    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 18:48:43.481817 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.481778    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-99c984dfb-469xj"]
May 28 18:48:43.533614 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.533574    2572 generic.go:358] "Generic (PLEG): container finished" podID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerID="f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26" exitCode=0
May 28 18:48:43.533775 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.533620    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerDied","Data":"f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26"}
May 28 18:48:43.535891 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.535864    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cjdv5" event={"ID":"e9208269-fa63-4699-a455-c591fdfb0166","Type":"ContainerStarted","Data":"de391131aa2e02b9ac5742e64c4bb1684f3ec5747e6e346345df7b2f9c6a3342"}
May 28 18:48:43.535984 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.535903    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cjdv5" event={"ID":"e9208269-fa63-4699-a455-c591fdfb0166","Type":"ContainerStarted","Data":"59bcc95bb7681ba9aa6051d0e32f9c3fb425a864737f8591fb83933283362dbe"}
May 28 18:48:43.581563 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.581524    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-config\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.581563 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.581561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf559\" (UniqueName: \"kubernetes.io/projected/d3903ce1-0b78-4539-8ea6-403eabc5246b-kube-api-access-rf559\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.581785 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.581686    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-service-ca\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.581785 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.581739    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-serving-cert\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.581785 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.581770    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-trusted-ca-bundle\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.581937 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.581851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-oauth-config\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.581937 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.581891    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-oauth-serving-cert\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.587205 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.587157    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cjdv5" podStartSLOduration=3.385024836 podStartE2EDuration="4.587142157s" podCreationTimestamp="2026-05-28 18:48:39 +0000 UTC" firstStartedPulling="2026-05-28 18:48:40.98935163 +0000 UTC m=+165.549126576" lastFinishedPulling="2026-05-28 18:48:42.191468933 +0000 UTC m=+166.751243897" observedRunningTime="2026-05-28 18:48:43.586657976 +0000 UTC m=+168.146432944" watchObservedRunningTime="2026-05-28 18:48:43.587142157 +0000 UTC m=+168.146917124"
May 28 18:48:43.682930 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.682886    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-oauth-config\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.683121 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.683040    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-oauth-serving-cert\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.683528 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.683505    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-config\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.683619 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.683543    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf559\" (UniqueName: \"kubernetes.io/projected/d3903ce1-0b78-4539-8ea6-403eabc5246b-kube-api-access-rf559\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.683679 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.683665    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-service-ca\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.684012 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.683983    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-oauth-serving-cert\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.684136 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.684116    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-serving-cert\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.684207 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.684183    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-trusted-ca-bundle\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.684374 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.684353    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-service-ca\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.685108 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.685089    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-config\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.685352 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.685329    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-trusted-ca-bundle\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.686164 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.686141    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-oauth-config\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.686663 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.686646    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-serving-cert\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.696129 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.696107    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf559\" (UniqueName: \"kubernetes.io/projected/d3903ce1-0b78-4539-8ea6-403eabc5246b-kube-api-access-rf559\") pod \"console-99c984dfb-469xj\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") " pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:43.776741 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:43.776674    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:44.413449 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:44.413427    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-99c984dfb-469xj"]
May 28 18:48:44.415753 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:44.415723    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3903ce1_0b78_4539_8ea6_403eabc5246b.slice/crio-2036370a9438cadbf8e904acf6ba83ee290c996405699796cbf75f3fa91836ec WatchSource:0}: Error finding container 2036370a9438cadbf8e904acf6ba83ee290c996405699796cbf75f3fa91836ec: Status 404 returned error can't find the container with id 2036370a9438cadbf8e904acf6ba83ee290c996405699796cbf75f3fa91836ec
May 28 18:48:44.540999 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:44.540966    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf" event={"ID":"f6cf9a92-4f1d-4d08-bd93-b8205def7461","Type":"ContainerStarted","Data":"098e1acb7fcf2fdde4518b03f5f155c37ae629ba6552aa4b5a84bb153b9559e6"}
May 28 18:48:44.541442 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:44.541010    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf" event={"ID":"f6cf9a92-4f1d-4d08-bd93-b8205def7461","Type":"ContainerStarted","Data":"e4fe5847dfd72e018deeab95fce1500621b9ca50a1c9361d44fd190053b6667d"}
May 28 18:48:44.541500 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:44.541457    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf" event={"ID":"f6cf9a92-4f1d-4d08-bd93-b8205def7461","Type":"ContainerStarted","Data":"036090d746c38cbe30771d129c0f88c2c7f76f75095963ccf840604a5f6fcf1a"}
May 28 18:48:44.543207 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:44.543156    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99c984dfb-469xj" event={"ID":"d3903ce1-0b78-4539-8ea6-403eabc5246b","Type":"ContainerStarted","Data":"2036370a9438cadbf8e904acf6ba83ee290c996405699796cbf75f3fa91836ec"}
May 28 18:48:45.057285 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:45.057250    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:48:46.552779 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.552733    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf" event={"ID":"f6cf9a92-4f1d-4d08-bd93-b8205def7461","Type":"ContainerStarted","Data":"41704f9a73c7ed076565b79afb993a541a1dc031ea6f78898c14397f7195fe0a"}
May 28 18:48:46.553229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.552788    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf" event={"ID":"f6cf9a92-4f1d-4d08-bd93-b8205def7461","Type":"ContainerStarted","Data":"d1c8d3f92de11e59a27ac4a380daac4ec7fb7aa71add6eb48a0da032c5d86b03"}
May 28 18:48:46.553229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.552804    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf" event={"ID":"f6cf9a92-4f1d-4d08-bd93-b8205def7461","Type":"ContainerStarted","Data":"c7e941c7a85fbe7e7e5dc9286eb3192e08f83209aedb3977c3bd7b6f829e8cc1"}
May 28 18:48:46.553229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.552940    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:46.556093 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.556064    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerStarted","Data":"4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30"}
May 28 18:48:46.556220 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.556100    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerStarted","Data":"5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887"}
May 28 18:48:46.556220 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.556115    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerStarted","Data":"05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76"}
May 28 18:48:46.556220 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.556132    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerStarted","Data":"20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e"}
May 28 18:48:46.556220 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.556144    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerStarted","Data":"6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888"}
May 28 18:48:46.556220 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.556156    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerStarted","Data":"dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f"}
May 28 18:48:46.573609 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.573560    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf" podStartSLOduration=1.986792866 podStartE2EDuration="5.573546093s" podCreationTimestamp="2026-05-28 18:48:41 +0000 UTC" firstStartedPulling="2026-05-28 18:48:42.146107877 +0000 UTC m=+166.705882823" lastFinishedPulling="2026-05-28 18:48:45.732861098 +0000 UTC m=+170.292636050" observedRunningTime="2026-05-28 18:48:46.571425928 +0000 UTC m=+171.131200896" watchObservedRunningTime="2026-05-28 18:48:46.573546093 +0000 UTC m=+171.133321062"
May 28 18:48:46.594864 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:46.594819    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.381591178 podStartE2EDuration="6.594805745s" podCreationTimestamp="2026-05-28 18:48:40 +0000 UTC" firstStartedPulling="2026-05-28 18:48:41.519852913 +0000 UTC m=+166.079627862" lastFinishedPulling="2026-05-28 18:48:45.73306748 +0000 UTC m=+170.292842429" observedRunningTime="2026-05-28 18:48:46.593109213 +0000 UTC m=+171.152884182" watchObservedRunningTime="2026-05-28 18:48:46.594805745 +0000 UTC m=+171.154580713"
May 28 18:48:48.564212 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.564179    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99c984dfb-469xj" event={"ID":"d3903ce1-0b78-4539-8ea6-403eabc5246b","Type":"ContainerStarted","Data":"aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb"}
May 28 18:48:48.580582 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.580536    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-99c984dfb-469xj" podStartSLOduration=2.349465119 podStartE2EDuration="5.580523131s" podCreationTimestamp="2026-05-28 18:48:43 +0000 UTC" firstStartedPulling="2026-05-28 18:48:44.417718943 +0000 UTC m=+168.977493902" lastFinishedPulling="2026-05-28 18:48:47.648776959 +0000 UTC m=+172.208551914" observedRunningTime="2026-05-28 18:48:48.579557298 +0000 UTC m=+173.139332267" watchObservedRunningTime="2026-05-28 18:48:48.580523131 +0000 UTC m=+173.140298098"
May 28 18:48:48.669037 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.669000    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-99c984dfb-469xj"]
May 28 18:48:48.690799 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.690768    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bdc6f5c66-7xfrf"]
May 28 18:48:48.692896 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.692879    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.700541 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.700518    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bdc6f5c66-7xfrf"]
May 28 18:48:48.839125 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.839031    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-oauth-serving-cert\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.839125 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.839068    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ptqj\" (UniqueName: \"kubernetes.io/projected/e5b7b807-374e-4f4f-83b9-cc8978b8544a-kube-api-access-7ptqj\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.839125 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.839096    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-trusted-ca-bundle\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.839345 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.839132    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-oauth-config\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.839345 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.839204    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-config\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.839345 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.839244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-serving-cert\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.839345 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.839274    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-service-ca\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.940724 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.940684    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-config\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.940920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.940754    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-serving-cert\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.940920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.940787    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-service-ca\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.940920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.940823    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-oauth-serving-cert\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.940920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.940844    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ptqj\" (UniqueName: \"kubernetes.io/projected/e5b7b807-374e-4f4f-83b9-cc8978b8544a-kube-api-access-7ptqj\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.940920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.940875    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-trusted-ca-bundle\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.940920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.940907    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-oauth-config\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.941633 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.941598    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-service-ca\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.941746 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.941608    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-oauth-serving-cert\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.941746 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.941702    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-config\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.942550 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.942522    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-trusted-ca-bundle\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.943307 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.943290    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-serving-cert\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.943578 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.943557    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-oauth-config\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:48.949651 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:48.949628    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ptqj\" (UniqueName: \"kubernetes.io/projected/e5b7b807-374e-4f4f-83b9-cc8978b8544a-kube-api-access-7ptqj\") pod \"console-5bdc6f5c66-7xfrf\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") " pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:49.002105 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:49.002069    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:48:49.122327 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:49.122258    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bdc6f5c66-7xfrf"]
May 28 18:48:49.125084 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:49.125055    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b7b807_374e_4f4f_83b9_cc8978b8544a.slice/crio-93913cc164971b144ba71290dc55304944737b2e4137b79bb0ce4b2eefad7c60 WatchSource:0}: Error finding container 93913cc164971b144ba71290dc55304944737b2e4137b79bb0ce4b2eefad7c60: Status 404 returned error can't find the container with id 93913cc164971b144ba71290dc55304944737b2e4137b79bb0ce4b2eefad7c60
May 28 18:48:49.568051 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:49.568018    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdc6f5c66-7xfrf" event={"ID":"e5b7b807-374e-4f4f-83b9-cc8978b8544a","Type":"ContainerStarted","Data":"b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4"}
May 28 18:48:49.568446 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:49.568064    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdc6f5c66-7xfrf" event={"ID":"e5b7b807-374e-4f4f-83b9-cc8978b8544a","Type":"ContainerStarted","Data":"93913cc164971b144ba71290dc55304944737b2e4137b79bb0ce4b2eefad7c60"}
May 28 18:48:49.585007 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:49.584939    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5bdc6f5c66-7xfrf" podStartSLOduration=1.584916975 podStartE2EDuration="1.584916975s" podCreationTimestamp="2026-05-28 18:48:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:48:49.583465519 +0000 UTC m=+174.143240487" watchObservedRunningTime="2026-05-28 18:48:49.584916975 +0000 UTC m=+174.144691943"
May 28 18:48:50.521531 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:50.521503    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4gpqv"
May 28 18:48:51.013063 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:51.013036    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:52.566470 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:52.566439    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-57fc9f6dcf-krbhf"
May 28 18:48:53.777264 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:53.777230    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-99c984dfb-469xj"
May 28 18:48:56.027160 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.027103    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-87db6449b-n6fww" podUID="e91b4cde-bdb6-4781-b6fe-9789f35b167a" containerName="registry" containerID="cri-o://be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8" gracePeriod=30
May 28 18:48:56.263585 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.263562    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:56.413063 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.413026    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-image-registry-private-configuration\") pod \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") "
May 28 18:48:56.413241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.413097    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-trusted-ca\") pod \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") "
May 28 18:48:56.413241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.413122    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-bound-sa-token\") pod \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") "
May 28 18:48:56.413241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.413152    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e91b4cde-bdb6-4781-b6fe-9789f35b167a-ca-trust-extracted\") pod \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") "
May 28 18:48:56.413241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.413181    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpjrc\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-kube-api-access-rpjrc\") pod \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") "
May 28 18:48:56.413241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.413210    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-certificates\") pod \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") "
May 28 18:48:56.413503 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.413248    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls\") pod \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") "
May 28 18:48:56.413503 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.413295    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-installation-pull-secrets\") pod \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\" (UID: \"e91b4cde-bdb6-4781-b6fe-9789f35b167a\") "
May 28 18:48:56.413641 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.413610    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e91b4cde-bdb6-4781-b6fe-9789f35b167a" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:48:56.413808 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.413781    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e91b4cde-bdb6-4781-b6fe-9789f35b167a" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:48:56.415725 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.415697    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e91b4cde-bdb6-4781-b6fe-9789f35b167a" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:48:56.415979 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.415948    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e91b4cde-bdb6-4781-b6fe-9789f35b167a" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:48:56.415979 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.415957    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e91b4cde-bdb6-4781-b6fe-9789f35b167a" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:48:56.416213 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.416193    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-kube-api-access-rpjrc" (OuterVolumeSpecName: "kube-api-access-rpjrc") pod "e91b4cde-bdb6-4781-b6fe-9789f35b167a" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a"). InnerVolumeSpecName "kube-api-access-rpjrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:48:56.416320 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.416217    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e91b4cde-bdb6-4781-b6fe-9789f35b167a" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:48:56.424103 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.424076    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e91b4cde-bdb6-4781-b6fe-9789f35b167a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e91b4cde-bdb6-4781-b6fe-9789f35b167a" (UID: "e91b4cde-bdb6-4781-b6fe-9789f35b167a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:48:56.514586 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.514551    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-image-registry-private-configuration\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:48:56.514586 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.514580    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-trusted-ca\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:48:56.514797 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.514597    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-bound-sa-token\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:48:56.514797 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.514606    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e91b4cde-bdb6-4781-b6fe-9789f35b167a-ca-trust-extracted\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:48:56.514797 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.514614    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpjrc\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-kube-api-access-rpjrc\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:48:56.514797 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.514624    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-certificates\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:48:56.514797 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.514632    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e91b4cde-bdb6-4781-b6fe-9789f35b167a-registry-tls\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:48:56.514797 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.514640    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e91b4cde-bdb6-4781-b6fe-9789f35b167a-installation-pull-secrets\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:48:56.589529 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.589488    2572 generic.go:358] "Generic (PLEG): container finished" podID="e91b4cde-bdb6-4781-b6fe-9789f35b167a" containerID="be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8" exitCode=0
May 28 18:48:56.589717 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.589557    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87db6449b-n6fww" event={"ID":"e91b4cde-bdb6-4781-b6fe-9789f35b167a","Type":"ContainerDied","Data":"be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8"}
May 28 18:48:56.589717 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.589589    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87db6449b-n6fww" event={"ID":"e91b4cde-bdb6-4781-b6fe-9789f35b167a","Type":"ContainerDied","Data":"952f7abdd281125f2769a79a1ee0136f714359a278a9e1858a5e5802943720ec"}
May 28 18:48:56.589717 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.589600    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87db6449b-n6fww"
May 28 18:48:56.589717 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.589609    2572 scope.go:117] "RemoveContainer" containerID="be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8"
May 28 18:48:56.602479 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.602456    2572 scope.go:117] "RemoveContainer" containerID="be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8"
May 28 18:48:56.602769 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:48:56.602750    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8\": container with ID starting with be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8 not found: ID does not exist" containerID="be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8"
May 28 18:48:56.602849 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.602777    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8"} err="failed to get container status \"be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8\": rpc error: code = NotFound desc = could not find container \"be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8\": container with ID starting with be7ed79679b4c66f531507f94789f5ff702b1c9065bff152f6adfc3eac52c4c8 not found: ID does not exist"
May 28 18:48:56.613732 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.613698    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-87db6449b-n6fww"]
May 28 18:48:56.618014 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.617987    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-87db6449b-n6fww"]
May 28 18:48:56.685759 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.685623    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bdc6f5c66-7xfrf"]
May 28 18:48:56.715722 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.715692    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dbb778c5f-8lbw8"]
May 28 18:48:56.716047 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.716035    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91b4cde-bdb6-4781-b6fe-9789f35b167a" containerName="registry"
May 28 18:48:56.716089 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.716049    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91b4cde-bdb6-4781-b6fe-9789f35b167a" containerName="registry"
May 28 18:48:56.716119 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.716093    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="e91b4cde-bdb6-4781-b6fe-9789f35b167a" containerName="registry"
May 28 18:48:56.719030 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.719012    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.726580 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.726560    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbb778c5f-8lbw8"]
May 28 18:48:56.817174 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.817137    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-oauth-serving-cert\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.817174 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.817181    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktl6z\" (UniqueName: \"kubernetes.io/projected/f471851c-8007-47fd-9476-b87e00d2171e-kube-api-access-ktl6z\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.817414 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.817202    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-serving-cert\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.817414 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.817292    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-oauth-config\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.817414 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.817341    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-service-ca\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.817414 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.817361    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-trusted-ca-bundle\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.817557 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.817435    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-console-config\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.918716 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.918673    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ktl6z\" (UniqueName: \"kubernetes.io/projected/f471851c-8007-47fd-9476-b87e00d2171e-kube-api-access-ktl6z\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.918902 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.918725    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-serving-cert\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.918902 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.918779    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-oauth-config\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.919004 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.918988    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-service-ca\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.919054 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.919021    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-trusted-ca-bundle\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.919104 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.919061    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-console-config\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.919153 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.919143    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-oauth-serving-cert\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.919675 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.919649    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-service-ca\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.919892 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.919869    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-oauth-serving-cert\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.919949 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.919928    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-trusted-ca-bundle\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.919981 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.919949    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-console-config\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.921158 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.921131    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-serving-cert\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.921253 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.921180    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-oauth-config\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:56.925610 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:56.925594    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktl6z\" (UniqueName: \"kubernetes.io/projected/f471851c-8007-47fd-9476-b87e00d2171e-kube-api-access-ktl6z\") pod \"console-7dbb778c5f-8lbw8\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") " pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:57.028437 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:57.028340    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:48:57.150586 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:57.150556    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dbb778c5f-8lbw8"]
May 28 18:48:57.153403 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:48:57.153359    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf471851c_8007_47fd_9476_b87e00d2171e.slice/crio-2d5909c9988203a16946bfac4d1a87a105b424a8b67b3cb35fa74d5d4f8564d2 WatchSource:0}: Error finding container 2d5909c9988203a16946bfac4d1a87a105b424a8b67b3cb35fa74d5d4f8564d2: Status 404 returned error can't find the container with id 2d5909c9988203a16946bfac4d1a87a105b424a8b67b3cb35fa74d5d4f8564d2
May 28 18:48:57.593357 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:57.593323    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbb778c5f-8lbw8" event={"ID":"f471851c-8007-47fd-9476-b87e00d2171e","Type":"ContainerStarted","Data":"153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2"}
May 28 18:48:57.593561 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:57.593365    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbb778c5f-8lbw8" event={"ID":"f471851c-8007-47fd-9476-b87e00d2171e","Type":"ContainerStarted","Data":"2d5909c9988203a16946bfac4d1a87a105b424a8b67b3cb35fa74d5d4f8564d2"}
May 28 18:48:57.608592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:57.608547    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7dbb778c5f-8lbw8" podStartSLOduration=1.608535103 podStartE2EDuration="1.608535103s" podCreationTimestamp="2026-05-28 18:48:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:48:57.60791055 +0000 UTC m=+182.167685518" watchObservedRunningTime="2026-05-28 18:48:57.608535103 +0000 UTC m=+182.168310070"
May 28 18:48:58.060571 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:58.060540    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e91b4cde-bdb6-4781-b6fe-9789f35b167a" path="/var/lib/kubelet/pods/e91b4cde-bdb6-4781-b6fe-9789f35b167a/volumes"
May 28 18:48:59.002395 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:48:59.002334    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:49:07.028489 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:07.028424    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:49:07.028489 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:07.028500    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:49:07.033212 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:07.033191    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:49:07.626129 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:07.626100    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:49:15.590090 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.590022    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-99c984dfb-469xj" podUID="d3903ce1-0b78-4539-8ea6-403eabc5246b" containerName="console" containerID="cri-o://aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb" gracePeriod=15
May 28 18:49:15.848548 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.848487    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-99c984dfb-469xj_d3903ce1-0b78-4539-8ea6-403eabc5246b/console/0.log"
May 28 18:49:15.848548 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.848546    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99c984dfb-469xj"
May 28 18:49:15.890635 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.890605    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-oauth-config\") pod \"d3903ce1-0b78-4539-8ea6-403eabc5246b\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") "
May 28 18:49:15.890797 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.890665    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-oauth-serving-cert\") pod \"d3903ce1-0b78-4539-8ea6-403eabc5246b\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") "
May 28 18:49:15.890797 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.890687    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-service-ca\") pod \"d3903ce1-0b78-4539-8ea6-403eabc5246b\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") "
May 28 18:49:15.890797 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.890711    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-trusted-ca-bundle\") pod \"d3903ce1-0b78-4539-8ea6-403eabc5246b\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") "
May 28 18:49:15.890797 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.890761    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-serving-cert\") pod \"d3903ce1-0b78-4539-8ea6-403eabc5246b\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") "
May 28 18:49:15.891006 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.890806    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-config\") pod \"d3903ce1-0b78-4539-8ea6-403eabc5246b\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") "
May 28 18:49:15.891006 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.890832    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf559\" (UniqueName: \"kubernetes.io/projected/d3903ce1-0b78-4539-8ea6-403eabc5246b-kube-api-access-rf559\") pod \"d3903ce1-0b78-4539-8ea6-403eabc5246b\" (UID: \"d3903ce1-0b78-4539-8ea6-403eabc5246b\") "
May 28 18:49:15.891177 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.891150    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-service-ca" (OuterVolumeSpecName: "service-ca") pod "d3903ce1-0b78-4539-8ea6-403eabc5246b" (UID: "d3903ce1-0b78-4539-8ea6-403eabc5246b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:49:15.891235 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.891169    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d3903ce1-0b78-4539-8ea6-403eabc5246b" (UID: "d3903ce1-0b78-4539-8ea6-403eabc5246b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:49:15.891235 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.891176    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-config" (OuterVolumeSpecName: "console-config") pod "d3903ce1-0b78-4539-8ea6-403eabc5246b" (UID: "d3903ce1-0b78-4539-8ea6-403eabc5246b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:49:15.891235 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.891160    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d3903ce1-0b78-4539-8ea6-403eabc5246b" (UID: "d3903ce1-0b78-4539-8ea6-403eabc5246b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:49:15.893139 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.893110    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d3903ce1-0b78-4539-8ea6-403eabc5246b" (UID: "d3903ce1-0b78-4539-8ea6-403eabc5246b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:49:15.893251 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.893156    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d3903ce1-0b78-4539-8ea6-403eabc5246b" (UID: "d3903ce1-0b78-4539-8ea6-403eabc5246b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:49:15.893251 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.893165    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3903ce1-0b78-4539-8ea6-403eabc5246b-kube-api-access-rf559" (OuterVolumeSpecName: "kube-api-access-rf559") pod "d3903ce1-0b78-4539-8ea6-403eabc5246b" (UID: "d3903ce1-0b78-4539-8ea6-403eabc5246b"). InnerVolumeSpecName "kube-api-access-rf559". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:49:15.992103 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.992065    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-service-ca\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:15.992103 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.992097    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-trusted-ca-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:15.992103 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.992108    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-serving-cert\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:15.992335 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.992117    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-config\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:15.992335 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.992127    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf559\" (UniqueName: \"kubernetes.io/projected/d3903ce1-0b78-4539-8ea6-403eabc5246b-kube-api-access-rf559\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:15.992335 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.992139    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3903ce1-0b78-4539-8ea6-403eabc5246b-console-oauth-config\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:15.992335 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:15.992151    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3903ce1-0b78-4539-8ea6-403eabc5246b-oauth-serving-cert\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:16.649563 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:16.649532    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-99c984dfb-469xj_d3903ce1-0b78-4539-8ea6-403eabc5246b/console/0.log"
May 28 18:49:16.649979 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:16.649572    2572 generic.go:358] "Generic (PLEG): container finished" podID="d3903ce1-0b78-4539-8ea6-403eabc5246b" containerID="aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb" exitCode=2
May 28 18:49:16.649979 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:16.649613    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99c984dfb-469xj" event={"ID":"d3903ce1-0b78-4539-8ea6-403eabc5246b","Type":"ContainerDied","Data":"aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb"}
May 28 18:49:16.649979 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:16.649635    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99c984dfb-469xj" event={"ID":"d3903ce1-0b78-4539-8ea6-403eabc5246b","Type":"ContainerDied","Data":"2036370a9438cadbf8e904acf6ba83ee290c996405699796cbf75f3fa91836ec"}
May 28 18:49:16.649979 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:16.649653    2572 scope.go:117] "RemoveContainer" containerID="aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb"
May 28 18:49:16.649979 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:16.649661    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99c984dfb-469xj"
May 28 18:49:16.657871 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:16.657849    2572 scope.go:117] "RemoveContainer" containerID="aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb"
May 28 18:49:16.658120 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:49:16.658097    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb\": container with ID starting with aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb not found: ID does not exist" containerID="aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb"
May 28 18:49:16.658183 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:16.658127    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb"} err="failed to get container status \"aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb\": rpc error: code = NotFound desc = could not find container \"aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb\": container with ID starting with aa0bddcdea8d727cc2caa3aaa9eb7536b9815945ce6c64ea1b3d11a3938ee7cb not found: ID does not exist"
May 28 18:49:16.664458 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:16.664436    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-99c984dfb-469xj"]
May 28 18:49:16.667714 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:16.667695    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-99c984dfb-469xj"]
May 28 18:49:18.060442 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:18.060408    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3903ce1-0b78-4539-8ea6-403eabc5246b" path="/var/lib/kubelet/pods/d3903ce1-0b78-4539-8ea6-403eabc5246b/volumes"
May 28 18:49:21.704981 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:21.704944    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5bdc6f5c66-7xfrf" podUID="e5b7b807-374e-4f4f-83b9-cc8978b8544a" containerName="console" containerID="cri-o://b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4" gracePeriod=15
May 28 18:49:21.951297 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:21.951277    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bdc6f5c66-7xfrf_e5b7b807-374e-4f4f-83b9-cc8978b8544a/console/0.log"
May 28 18:49:21.951437 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:21.951334    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:49:22.044370 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.044283    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-oauth-serving-cert\") pod \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") "
May 28 18:49:22.044370 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.044322    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-trusted-ca-bundle\") pod \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") "
May 28 18:49:22.044370 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.044364    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-config\") pod \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") "
May 28 18:49:22.044656 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.044440    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-oauth-config\") pod \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") "
May 28 18:49:22.044656 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.044502    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ptqj\" (UniqueName: \"kubernetes.io/projected/e5b7b807-374e-4f4f-83b9-cc8978b8544a-kube-api-access-7ptqj\") pod \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") "
May 28 18:49:22.044656 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.044529    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-serving-cert\") pod \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") "
May 28 18:49:22.044656 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.044583    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-service-ca\") pod \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\" (UID: \"e5b7b807-374e-4f4f-83b9-cc8978b8544a\") "
May 28 18:49:22.044877 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.044762    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-config" (OuterVolumeSpecName: "console-config") pod "e5b7b807-374e-4f4f-83b9-cc8978b8544a" (UID: "e5b7b807-374e-4f4f-83b9-cc8978b8544a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:49:22.044942 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.044785    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e5b7b807-374e-4f4f-83b9-cc8978b8544a" (UID: "e5b7b807-374e-4f4f-83b9-cc8978b8544a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:49:22.044996 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.044983    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-oauth-serving-cert\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:22.045047 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.044998    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-config\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:22.045047 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.045018    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e5b7b807-374e-4f4f-83b9-cc8978b8544a" (UID: "e5b7b807-374e-4f4f-83b9-cc8978b8544a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:49:22.045119 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.045077    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-service-ca" (OuterVolumeSpecName: "service-ca") pod "e5b7b807-374e-4f4f-83b9-cc8978b8544a" (UID: "e5b7b807-374e-4f4f-83b9-cc8978b8544a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:49:22.046913 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.046890    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b7b807-374e-4f4f-83b9-cc8978b8544a-kube-api-access-7ptqj" (OuterVolumeSpecName: "kube-api-access-7ptqj") pod "e5b7b807-374e-4f4f-83b9-cc8978b8544a" (UID: "e5b7b807-374e-4f4f-83b9-cc8978b8544a"). InnerVolumeSpecName "kube-api-access-7ptqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:49:22.047111 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.047080    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e5b7b807-374e-4f4f-83b9-cc8978b8544a" (UID: "e5b7b807-374e-4f4f-83b9-cc8978b8544a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:49:22.047111 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.047102    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e5b7b807-374e-4f4f-83b9-cc8978b8544a" (UID: "e5b7b807-374e-4f4f-83b9-cc8978b8544a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:49:22.146210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.146171    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-service-ca\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:22.146210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.146203    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5b7b807-374e-4f4f-83b9-cc8978b8544a-trusted-ca-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:22.146210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.146213    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-oauth-config\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:22.146456 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.146222    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ptqj\" (UniqueName: \"kubernetes.io/projected/e5b7b807-374e-4f4f-83b9-cc8978b8544a-kube-api-access-7ptqj\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:22.146456 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.146232    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5b7b807-374e-4f4f-83b9-cc8978b8544a-console-serving-cert\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:49:22.667718 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.667690    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bdc6f5c66-7xfrf_e5b7b807-374e-4f4f-83b9-cc8978b8544a/console/0.log"
May 28 18:49:22.667883 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.667729    2572 generic.go:358] "Generic (PLEG): container finished" podID="e5b7b807-374e-4f4f-83b9-cc8978b8544a" containerID="b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4" exitCode=2
May 28 18:49:22.667883 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.667827    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdc6f5c66-7xfrf"
May 28 18:49:22.667953 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.667829    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdc6f5c66-7xfrf" event={"ID":"e5b7b807-374e-4f4f-83b9-cc8978b8544a","Type":"ContainerDied","Data":"b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4"}
May 28 18:49:22.667953 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.667932    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdc6f5c66-7xfrf" event={"ID":"e5b7b807-374e-4f4f-83b9-cc8978b8544a","Type":"ContainerDied","Data":"93913cc164971b144ba71290dc55304944737b2e4137b79bb0ce4b2eefad7c60"}
May 28 18:49:22.667953 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.667948    2572 scope.go:117] "RemoveContainer" containerID="b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4"
May 28 18:49:22.676206 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.676188    2572 scope.go:117] "RemoveContainer" containerID="b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4"
May 28 18:49:22.676477 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:49:22.676458    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4\": container with ID starting with b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4 not found: ID does not exist" containerID="b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4"
May 28 18:49:22.676527 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.676485    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4"} err="failed to get container status \"b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4\": rpc error: code = NotFound desc = could not find container \"b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4\": container with ID starting with b07fadd722046f061ceecf816e81a4c31d1e2aaa118b2a4b1dc1d19255810db4 not found: ID does not exist"
May 28 18:49:22.683150 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.683120    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bdc6f5c66-7xfrf"]
May 28 18:49:22.687105 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:22.687086    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bdc6f5c66-7xfrf"]
May 28 18:49:24.060494 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:24.060460    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5b7b807-374e-4f4f-83b9-cc8978b8544a" path="/var/lib/kubelet/pods/e5b7b807-374e-4f4f-83b9-cc8978b8544a/volumes"
May 28 18:49:59.454719 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.454682    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 18:49:59.455114 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.455094    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="alertmanager" containerID="cri-o://dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f" gracePeriod=120
May 28 18:49:59.455270 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.455186    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="config-reloader" containerID="cri-o://6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888" gracePeriod=120
May 28 18:49:59.455270 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.455173    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy-metric" containerID="cri-o://5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887" gracePeriod=120
May 28 18:49:59.455270 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.455231    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="prom-label-proxy" containerID="cri-o://4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30" gracePeriod=120
May 28 18:49:59.455560 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.455251    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy" containerID="cri-o://05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76" gracePeriod=120
May 28 18:49:59.455560 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.455173    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy-web" containerID="cri-o://20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e" gracePeriod=120
May 28 18:49:59.776187 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.776090    2572 generic.go:358] "Generic (PLEG): container finished" podID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerID="4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30" exitCode=0
May 28 18:49:59.776187 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.776119    2572 generic.go:358] "Generic (PLEG): container finished" podID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerID="05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76" exitCode=0
May 28 18:49:59.776187 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.776130    2572 generic.go:358] "Generic (PLEG): container finished" podID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerID="6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888" exitCode=0
May 28 18:49:59.776187 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.776138    2572 generic.go:358] "Generic (PLEG): container finished" podID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerID="dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f" exitCode=0
May 28 18:49:59.776187 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.776171    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerDied","Data":"4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30"}
May 28 18:49:59.776468 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.776204    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerDied","Data":"05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76"}
May 28 18:49:59.776468 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.776214    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerDied","Data":"6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888"}
May 28 18:49:59.776468 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:49:59.776223    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerDied","Data":"dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f"}
May 28 18:50:00.692660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.692637    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:00.748944 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.748904    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6569b5f748-frlcn"]
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749205    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy"
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749217    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy"
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749228    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="alertmanager"
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749236    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="alertmanager"
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749243    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="prom-label-proxy"
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749249    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="prom-label-proxy"
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749256    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b7b807-374e-4f4f-83b9-cc8978b8544a" containerName="console"
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749261    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b7b807-374e-4f4f-83b9-cc8978b8544a" containerName="console"
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749268    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy-metric"
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749273    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy-metric"
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749279    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3903ce1-0b78-4539-8ea6-403eabc5246b" containerName="console"
May 28 18:50:00.749279 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749283    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3903ce1-0b78-4539-8ea6-403eabc5246b" containerName="console"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749290    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy-web"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749298    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy-web"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749308    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="config-reloader"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749316    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="config-reloader"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749332    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="init-config-reloader"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749341    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="init-config-reloader"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749411    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy-web"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749422    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5b7b807-374e-4f4f-83b9-cc8978b8544a" containerName="console"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749429    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="prom-label-proxy"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749436    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy-metric"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749443    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="d3903ce1-0b78-4539-8ea6-403eabc5246b" containerName="console"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749449    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="kube-rbac-proxy"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749455    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="alertmanager"
May 28 18:50:00.749694 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.749461    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerName="config-reloader"
May 28 18:50:00.752709 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.752686    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.770977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.770862    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vnct\" (UniqueName: \"kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-kube-api-access-7vnct\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.770977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.770906    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-web\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.770977 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.770932    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-web-config\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771052    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771089    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-volume\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771128    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-tls-assets\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771150    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-out\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771203    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-main-db\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771262    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-trusted-ca-bundle\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771292    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-metrics-client-ca\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771322    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-main-tls\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771347    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-cluster-tls-config\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771371    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\" (UID: \"619d4b59-07f7-433e-b3c9-a1bed870f6fa\") "
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771522    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-console-config\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.771559 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-service-ca\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.772149 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771603    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/83802f71-764a-4ad8-95d5-c4b681296b4b-kube-api-access-ctl7k\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.772149 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771640    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-oauth-config\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.772149 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771673    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-trusted-ca-bundle\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.772149 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-oauth-serving-cert\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.772149 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.771823    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-serving-cert\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.772478 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.772221    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:50:00.772478 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.772262    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:50:00.772634 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.772604    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:50:00.774832 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.774651    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6569b5f748-frlcn"]
May 28 18:50:00.774832 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.774778    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:50:00.775450 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.775416    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-volume" (OuterVolumeSpecName: "config-volume") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:50:00.775759 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.775732    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:50:00.775966 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.775943    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-kube-api-access-7vnct" (OuterVolumeSpecName: "kube-api-access-7vnct") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "kube-api-access-7vnct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:50:00.776055 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.775984    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:50:00.777221 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.777166    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-out" (OuterVolumeSpecName: "config-out") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:50:00.777326 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.777281    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:50:00.777858 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.777833    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:50:00.781441 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.781418    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:50:00.784126 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.784104    2572 generic.go:358] "Generic (PLEG): container finished" podID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerID="5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887" exitCode=0
May 28 18:50:00.784126 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.784126    2572 generic.go:358] "Generic (PLEG): container finished" podID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" containerID="20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e" exitCode=0
May 28 18:50:00.784280 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.784189    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerDied","Data":"5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887"}
May 28 18:50:00.784280 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.784221    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerDied","Data":"20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e"}
May 28 18:50:00.784280 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.784231    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"619d4b59-07f7-433e-b3c9-a1bed870f6fa","Type":"ContainerDied","Data":"afaf8fde41d4c23d52e313675c219ca1a2911b47c916797eb06d8ba07ef015de"}
May 28 18:50:00.784280 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.784245    2572 scope.go:117] "RemoveContainer" containerID="4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30"
May 28 18:50:00.784280 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.784255    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:00.788101 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.788081    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-web-config" (OuterVolumeSpecName: "web-config") pod "619d4b59-07f7-433e-b3c9-a1bed870f6fa" (UID: "619d4b59-07f7-433e-b3c9-a1bed870f6fa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:50:00.791804 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.791789    2572 scope.go:117] "RemoveContainer" containerID="5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887"
May 28 18:50:00.797943 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.797921    2572 scope.go:117] "RemoveContainer" containerID="05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76"
May 28 18:50:00.803949 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.803933    2572 scope.go:117] "RemoveContainer" containerID="20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e"
May 28 18:50:00.809793 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.809764    2572 scope.go:117] "RemoveContainer" containerID="6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888"
May 28 18:50:00.815759 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.815744    2572 scope.go:117] "RemoveContainer" containerID="dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f"
May 28 18:50:00.822165 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.822148    2572 scope.go:117] "RemoveContainer" containerID="f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26"
May 28 18:50:00.829257 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.829237    2572 scope.go:117] "RemoveContainer" containerID="4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30"
May 28 18:50:00.829525 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:50:00.829505    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30\": container with ID starting with 4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30 not found: ID does not exist" containerID="4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30"
May 28 18:50:00.829598 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.829530    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30"} err="failed to get container status \"4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30\": rpc error: code = NotFound desc = could not find container \"4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30\": container with ID starting with 4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30 not found: ID does not exist"
May 28 18:50:00.829598 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.829548    2572 scope.go:117] "RemoveContainer" containerID="5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887"
May 28 18:50:00.829809 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:50:00.829784    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887\": container with ID starting with 5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887 not found: ID does not exist" containerID="5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887"
May 28 18:50:00.829853 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.829814    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887"} err="failed to get container status \"5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887\": rpc error: code = NotFound desc = could not find container \"5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887\": container with ID starting with 5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887 not found: ID does not exist"
May 28 18:50:00.829853 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.829830    2572 scope.go:117] "RemoveContainer" containerID="05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76"
May 28 18:50:00.830092 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:50:00.830074    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76\": container with ID starting with 05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76 not found: ID does not exist" containerID="05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76"
May 28 18:50:00.830154 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.830103    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76"} err="failed to get container status \"05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76\": rpc error: code = NotFound desc = could not find container \"05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76\": container with ID starting with 05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76 not found: ID does not exist"
May 28 18:50:00.830154 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.830126    2572 scope.go:117] "RemoveContainer" containerID="20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e"
May 28 18:50:00.830355 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:50:00.830338    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e\": container with ID starting with 20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e not found: ID does not exist" containerID="20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e"
May 28 18:50:00.830421 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.830360    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e"} err="failed to get container status \"20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e\": rpc error: code = NotFound desc = could not find container \"20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e\": container with ID starting with 20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e not found: ID does not exist"
May 28 18:50:00.830421 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.830377    2572 scope.go:117] "RemoveContainer" containerID="6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888"
May 28 18:50:00.830668 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:50:00.830648    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888\": container with ID starting with 6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888 not found: ID does not exist" containerID="6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888"
May 28 18:50:00.830716 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.830675    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888"} err="failed to get container status \"6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888\": rpc error: code = NotFound desc = could not find container \"6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888\": container with ID starting with 6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888 not found: ID does not exist"
May 28 18:50:00.830716 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.830695    2572 scope.go:117] "RemoveContainer" containerID="dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f"
May 28 18:50:00.830957 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:50:00.830924    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f\": container with ID starting with dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f not found: ID does not exist" containerID="dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f"
May 28 18:50:00.831030 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.830964    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f"} err="failed to get container status \"dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f\": rpc error: code = NotFound desc = could not find container \"dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f\": container with ID starting with dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f not found: ID does not exist"
May 28 18:50:00.831030 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.830983    2572 scope.go:117] "RemoveContainer" containerID="f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26"
May 28 18:50:00.831229 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:50:00.831212    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26\": container with ID starting with f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26 not found: ID does not exist" containerID="f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26"
May 28 18:50:00.831274 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.831234    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26"} err="failed to get container status \"f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26\": rpc error: code = NotFound desc = could not find container \"f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26\": container with ID starting with f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26 not found: ID does not exist"
May 28 18:50:00.831274 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.831250    2572 scope.go:117] "RemoveContainer" containerID="4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30"
May 28 18:50:00.831499 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.831483    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30"} err="failed to get container status \"4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30\": rpc error: code = NotFound desc = could not find container \"4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30\": container with ID starting with 4b7507b5621c15da678fc1d67a0496e7c1a747fd30bd2bd6c246c0ce21e8df30 not found: ID does not exist"
May 28 18:50:00.831548 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.831500    2572 scope.go:117] "RemoveContainer" containerID="5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887"
May 28 18:50:00.831673 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.831652    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887"} err="failed to get container status \"5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887\": rpc error: code = NotFound desc = could not find container \"5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887\": container with ID starting with 5faf2ebdc11c12ff5f9c330c2092821246075e940453e5852be227b9e4099887 not found: ID does not exist"
May 28 18:50:00.831714 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.831674    2572 scope.go:117] "RemoveContainer" containerID="05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76"
May 28 18:50:00.831886 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.831867    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76"} err="failed to get container status \"05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76\": rpc error: code = NotFound desc = could not find container \"05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76\": container with ID starting with 05b3ce59001c21770dd0b12d5e14a6b3d3a486050c22440e702ca9bd7b3eec76 not found: ID does not exist"
May 28 18:50:00.831931 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.831887    2572 scope.go:117] "RemoveContainer" containerID="20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e"
May 28 18:50:00.832065 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.832048    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e"} err="failed to get container status \"20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e\": rpc error: code = NotFound desc = could not find container \"20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e\": container with ID starting with 20cfc63d119d472a8e21f56e1716ee586bad193054d359134ac988cb0f0b0a9e not found: ID does not exist"
May 28 18:50:00.832065 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.832064    2572 scope.go:117] "RemoveContainer" containerID="6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888"
May 28 18:50:00.832250 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.832235    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888"} err="failed to get container status \"6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888\": rpc error: code = NotFound desc = could not find container \"6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888\": container with ID starting with 6308f002938540e53a519187047f0c0c18135b7d84b4b5821ce19a352e995888 not found: ID does not exist"
May 28 18:50:00.832288 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.832249    2572 scope.go:117] "RemoveContainer" containerID="dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f"
May 28 18:50:00.832433 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.832417    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f"} err="failed to get container status \"dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f\": rpc error: code = NotFound desc = could not find container \"dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f\": container with ID starting with dbf2e55a074d932e8a2da74fdb18c024fc5a551c94446c8c93813686a216b96f not found: ID does not exist"
May 28 18:50:00.832515 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.832435    2572 scope.go:117] "RemoveContainer" containerID="f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26"
May 28 18:50:00.832616 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.832600    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26"} err="failed to get container status \"f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26\": rpc error: code = NotFound desc = could not find container \"f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26\": container with ID starting with f89291e89e1b1f43d83d9f0e1be42d0e89cdbc353ce7c75dede3c69cf6021d26 not found: ID does not exist"
May 28 18:50:00.872332 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872298    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-serving-cert\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.872494 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872341    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-console-config\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.872494 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872372    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-service-ca\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.872494 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872429    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/83802f71-764a-4ad8-95d5-c4b681296b4b-kube-api-access-ctl7k\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.872494 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872461    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-oauth-config\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.872494 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872490    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-trusted-ca-bundle\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.872764 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872628    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-oauth-serving-cert\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.872764 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872713    2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-tls-assets\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872764 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872731    2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-out\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872764 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872747    2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-main-db\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872764    2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872781    2572 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/619d4b59-07f7-433e-b3c9-a1bed870f6fa-metrics-client-ca\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872796    2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-main-tls\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872811    2572 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-cluster-tls-config\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872828    2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872845    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vnct\" (UniqueName: \"kubernetes.io/projected/619d4b59-07f7-433e-b3c9-a1bed870f6fa-kube-api-access-7vnct\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872859    2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872875    2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-web-config\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872888    2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.872956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.872899    2572 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/619d4b59-07f7-433e-b3c9-a1bed870f6fa-config-volume\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:00.873544 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.873137    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-console-config\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.873544 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.873241    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-service-ca\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.873544 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.873438    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-trusted-ca-bundle\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.873544 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.873448    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-oauth-serving-cert\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.874882 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.874860    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-oauth-config\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.875000 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.874984    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-serving-cert\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:00.880868 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:00.880851    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/83802f71-764a-4ad8-95d5-c4b681296b4b-kube-api-access-ctl7k\") pod \"console-6569b5f748-frlcn\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") " pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:01.063262 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.063235    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:01.112654 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.112628    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 18:50:01.117533 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.117506    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 18:50:01.145365 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.145340    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 18:50:01.151134 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.151111    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.153379 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.153355    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 18:50:01.153502 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.153485    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 18:50:01.153567 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.153355    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 18:50:01.153616 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.153361    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 18:50:01.153692 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.153680    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 18:50:01.153816 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.153742    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 18:50:01.154158 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.153834    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 18:50:01.154158 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.154018    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 18:50:01.154158 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.154039    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-twssl\""
May 28 18:50:01.159048 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.159024    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 18:50:01.162311 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.162285    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 18:50:01.174746 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.174719    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19bef3d1-57ed-4168-a898-a9c9701e9f97-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.174863 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.174775    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-config-volume\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.174863 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.174836    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-284pz\" (UniqueName: \"kubernetes.io/projected/19bef3d1-57ed-4168-a898-a9c9701e9f97-kube-api-access-284pz\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.174983 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.174864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.174983 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.174890    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19bef3d1-57ed-4168-a898-a9c9701e9f97-tls-assets\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.174983 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.174914    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.174983 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.174939    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.175179 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.174999    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19bef3d1-57ed-4168-a898-a9c9701e9f97-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.175179 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.175053    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19bef3d1-57ed-4168-a898-a9c9701e9f97-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.175179 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.175088    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.175179 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.175122    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.175179 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.175154    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19bef3d1-57ed-4168-a898-a9c9701e9f97-config-out\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.175359 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.175186    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-web-config\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.203742 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.203709    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6569b5f748-frlcn"]
May 28 18:50:01.206805 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:50:01.206783    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83802f71_764a_4ad8_95d5_c4b681296b4b.slice/crio-e70938b7035b5524cbaa2238a666f4f5c2efd9006e3754e179234219289c2d8c WatchSource:0}: Error finding container e70938b7035b5524cbaa2238a666f4f5c2efd9006e3754e179234219289c2d8c: Status 404 returned error can't find the container with id e70938b7035b5524cbaa2238a666f4f5c2efd9006e3754e179234219289c2d8c
May 28 18:50:01.276127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276095    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19bef3d1-57ed-4168-a898-a9c9701e9f97-config-out\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276133    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-web-config\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276171    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19bef3d1-57ed-4168-a898-a9c9701e9f97-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276214    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-config-volume\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276252    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-284pz\" (UniqueName: \"kubernetes.io/projected/19bef3d1-57ed-4168-a898-a9c9701e9f97-kube-api-access-284pz\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276287 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276285    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276567 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276316    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19bef3d1-57ed-4168-a898-a9c9701e9f97-tls-assets\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276567 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276341    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276567 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276365    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276728 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276704    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19bef3d1-57ed-4168-a898-a9c9701e9f97-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276765 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276746    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19bef3d1-57ed-4168-a898-a9c9701e9f97-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276810 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276793    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.276857 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276834    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.277167 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.276935    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19bef3d1-57ed-4168-a898-a9c9701e9f97-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.277912 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.277881    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19bef3d1-57ed-4168-a898-a9c9701e9f97-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.278203 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.278176    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/19bef3d1-57ed-4168-a898-a9c9701e9f97-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.278780 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.278756    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/19bef3d1-57ed-4168-a898-a9c9701e9f97-config-out\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.279747 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.279721    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/19bef3d1-57ed-4168-a898-a9c9701e9f97-tls-assets\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.280170 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.280147    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.280246 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.280212    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-config-volume\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.280590 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.280568    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.280686 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.280659    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-web-config\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.280738 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.280699    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.281044 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.281020    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.281179 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.281161    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/19bef3d1-57ed-4168-a898-a9c9701e9f97-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.285798 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.285777    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-284pz\" (UniqueName: \"kubernetes.io/projected/19bef3d1-57ed-4168-a898-a9c9701e9f97-kube-api-access-284pz\") pod \"alertmanager-main-0\" (UID: \"19bef3d1-57ed-4168-a898-a9c9701e9f97\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.462879 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.462785    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 18:50:01.612447 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.612420    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 18:50:01.614863 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:50:01.614828    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19bef3d1_57ed_4168_a898_a9c9701e9f97.slice/crio-f46d0b1775fb0fbe2965d5d47beea55f30da089805959b21760426b0c38f9e22 WatchSource:0}: Error finding container f46d0b1775fb0fbe2965d5d47beea55f30da089805959b21760426b0c38f9e22: Status 404 returned error can't find the container with id f46d0b1775fb0fbe2965d5d47beea55f30da089805959b21760426b0c38f9e22
May 28 18:50:01.789460 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.789357    2572 generic.go:358] "Generic (PLEG): container finished" podID="19bef3d1-57ed-4168-a898-a9c9701e9f97" containerID="d52807ee23250356b5b8f6548914646f2b780eb474fdd46aa4c264ac54530402" exitCode=0
May 28 18:50:01.789460 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.789420    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19bef3d1-57ed-4168-a898-a9c9701e9f97","Type":"ContainerDied","Data":"d52807ee23250356b5b8f6548914646f2b780eb474fdd46aa4c264ac54530402"}
May 28 18:50:01.789460 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.789457    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19bef3d1-57ed-4168-a898-a9c9701e9f97","Type":"ContainerStarted","Data":"f46d0b1775fb0fbe2965d5d47beea55f30da089805959b21760426b0c38f9e22"}
May 28 18:50:01.790860 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.790837    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6569b5f748-frlcn" event={"ID":"83802f71-764a-4ad8-95d5-c4b681296b4b","Type":"ContainerStarted","Data":"432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887"}
May 28 18:50:01.790997 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.790863    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6569b5f748-frlcn" event={"ID":"83802f71-764a-4ad8-95d5-c4b681296b4b","Type":"ContainerStarted","Data":"e70938b7035b5524cbaa2238a666f4f5c2efd9006e3754e179234219289c2d8c"}
May 28 18:50:01.837255 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:01.837205    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6569b5f748-frlcn" podStartSLOduration=1.837190688 podStartE2EDuration="1.837190688s" podCreationTimestamp="2026-05-28 18:50:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:50:01.836378823 +0000 UTC m=+246.396153791" watchObservedRunningTime="2026-05-28 18:50:01.837190688 +0000 UTC m=+246.396965656"
May 28 18:50:02.061141 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:02.061116    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="619d4b59-07f7-433e-b3c9-a1bed870f6fa" path="/var/lib/kubelet/pods/619d4b59-07f7-433e-b3c9-a1bed870f6fa/volumes"
May 28 18:50:02.796274 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:02.796189    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19bef3d1-57ed-4168-a898-a9c9701e9f97","Type":"ContainerStarted","Data":"d7f3c86cf2e19db57cb0491beb8586b41b5b685d77ae29f1b160f8fd84ebbfac"}
May 28 18:50:02.796274 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:02.796235    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19bef3d1-57ed-4168-a898-a9c9701e9f97","Type":"ContainerStarted","Data":"63a62e7de0639d2f73f1239df68f815d5cc58d480428e8776e755ea65748c45a"}
May 28 18:50:02.796274 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:02.796245    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19bef3d1-57ed-4168-a898-a9c9701e9f97","Type":"ContainerStarted","Data":"29983389dcd163a09563054403696618d39b4be1a096f6b47624198d12e56db9"}
May 28 18:50:02.796274 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:02.796255    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19bef3d1-57ed-4168-a898-a9c9701e9f97","Type":"ContainerStarted","Data":"2d7e9869a15376ad1baa9d2fcb52467d4c870f867e974285652aa39fc7eed823"}
May 28 18:50:02.796274 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:02.796263    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19bef3d1-57ed-4168-a898-a9c9701e9f97","Type":"ContainerStarted","Data":"e58f0b31ce43eeef8f00807286700bac63e597d133cb805935268676d673040a"}
May 28 18:50:02.796274 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:02.796271    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"19bef3d1-57ed-4168-a898-a9c9701e9f97","Type":"ContainerStarted","Data":"a2e731681c99fa752c8bf89262e50afc19b097defbff2550cf86a8105aa143aa"}
May 28 18:50:02.825342 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:02.825211    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.825195583 podStartE2EDuration="1.825195583s" podCreationTimestamp="2026-05-28 18:50:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:50:02.825088332 +0000 UTC m=+247.384863302" watchObservedRunningTime="2026-05-28 18:50:02.825195583 +0000 UTC m=+247.384970553"
May 28 18:50:07.834128 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:07.834072    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:50:07.836303 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:07.836283    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7cc5970-0522-44ea-b02e-1ff310c0793c-metrics-certs\") pod \"network-metrics-daemon-shplj\" (UID: \"a7cc5970-0522-44ea-b02e-1ff310c0793c\") " pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:50:07.860786 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:07.860762    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-25f4v\""
May 28 18:50:07.868513 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:07.868496    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shplj"
May 28 18:50:07.986267 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:07.986229    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-shplj"]
May 28 18:50:07.989316 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:50:07.989287    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7cc5970_0522_44ea_b02e_1ff310c0793c.slice/crio-ab897528abcf330554d4a96a519a925755899a65736bf8af6b4ebbfd5ee4e87f WatchSource:0}: Error finding container ab897528abcf330554d4a96a519a925755899a65736bf8af6b4ebbfd5ee4e87f: Status 404 returned error can't find the container with id ab897528abcf330554d4a96a519a925755899a65736bf8af6b4ebbfd5ee4e87f
May 28 18:50:08.815921 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:08.815883    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shplj" event={"ID":"a7cc5970-0522-44ea-b02e-1ff310c0793c","Type":"ContainerStarted","Data":"ab897528abcf330554d4a96a519a925755899a65736bf8af6b4ebbfd5ee4e87f"}
May 28 18:50:09.820033 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:09.819998    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shplj" event={"ID":"a7cc5970-0522-44ea-b02e-1ff310c0793c","Type":"ContainerStarted","Data":"2eb6d97ab4d5e6d6720cb6d536a6b3e6d09c5203fb2ba8e354bf687122890693"}
May 28 18:50:09.820033 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:09.820032    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shplj" event={"ID":"a7cc5970-0522-44ea-b02e-1ff310c0793c","Type":"ContainerStarted","Data":"c05ebbcaa15078e940169fd17a83de2cc25fca391850a63f026a3aee544f8147"}
May 28 18:50:09.836484 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:09.836437    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-shplj" podStartSLOduration=252.843953563 podStartE2EDuration="4m13.836423851s" podCreationTimestamp="2026-05-28 18:45:56 +0000 UTC" firstStartedPulling="2026-05-28 18:50:07.99100454 +0000 UTC m=+252.550779490" lastFinishedPulling="2026-05-28 18:50:08.983474829 +0000 UTC m=+253.543249778" observedRunningTime="2026-05-28 18:50:09.834543993 +0000 UTC m=+254.394318959" watchObservedRunningTime="2026-05-28 18:50:09.836423851 +0000 UTC m=+254.396198818"
May 28 18:50:11.063540 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:11.063511    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:11.063869 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:11.063551    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:11.068122 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:11.068100    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:11.830138 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:11.830111    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:50:11.881128 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:11.881087    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dbb778c5f-8lbw8"]
May 28 18:50:36.901639 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:36.901599    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7dbb778c5f-8lbw8" podUID="f471851c-8007-47fd-9476-b87e00d2171e" containerName="console" containerID="cri-o://153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2" gracePeriod=15
May 28 18:50:37.141724 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.141701    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dbb778c5f-8lbw8_f471851c-8007-47fd-9476-b87e00d2171e/console/0.log"
May 28 18:50:37.141846 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.141759    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:50:37.287534 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.287437    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-serving-cert\") pod \"f471851c-8007-47fd-9476-b87e00d2171e\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") "
May 28 18:50:37.287534 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.287504    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktl6z\" (UniqueName: \"kubernetes.io/projected/f471851c-8007-47fd-9476-b87e00d2171e-kube-api-access-ktl6z\") pod \"f471851c-8007-47fd-9476-b87e00d2171e\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") "
May 28 18:50:37.287534 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.287527    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-trusted-ca-bundle\") pod \"f471851c-8007-47fd-9476-b87e00d2171e\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") "
May 28 18:50:37.287796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.287586    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-oauth-serving-cert\") pod \"f471851c-8007-47fd-9476-b87e00d2171e\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") "
May 28 18:50:37.287796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.287648    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-oauth-config\") pod \"f471851c-8007-47fd-9476-b87e00d2171e\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") "
May 28 18:50:37.287796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.287768    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-service-ca\") pod \"f471851c-8007-47fd-9476-b87e00d2171e\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") "
May 28 18:50:37.287939 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.287811    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-console-config\") pod \"f471851c-8007-47fd-9476-b87e00d2171e\" (UID: \"f471851c-8007-47fd-9476-b87e00d2171e\") "
May 28 18:50:37.288108 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.287986    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f471851c-8007-47fd-9476-b87e00d2171e" (UID: "f471851c-8007-47fd-9476-b87e00d2171e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:50:37.288108 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.288084    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f471851c-8007-47fd-9476-b87e00d2171e" (UID: "f471851c-8007-47fd-9476-b87e00d2171e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:50:37.288242 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.288156    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-service-ca" (OuterVolumeSpecName: "service-ca") pod "f471851c-8007-47fd-9476-b87e00d2171e" (UID: "f471851c-8007-47fd-9476-b87e00d2171e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:50:37.288321 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.288300    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-console-config" (OuterVolumeSpecName: "console-config") pod "f471851c-8007-47fd-9476-b87e00d2171e" (UID: "f471851c-8007-47fd-9476-b87e00d2171e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:50:37.289708 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.289687    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f471851c-8007-47fd-9476-b87e00d2171e-kube-api-access-ktl6z" (OuterVolumeSpecName: "kube-api-access-ktl6z") pod "f471851c-8007-47fd-9476-b87e00d2171e" (UID: "f471851c-8007-47fd-9476-b87e00d2171e"). InnerVolumeSpecName "kube-api-access-ktl6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:50:37.290109 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.290089    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f471851c-8007-47fd-9476-b87e00d2171e" (UID: "f471851c-8007-47fd-9476-b87e00d2171e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:50:37.290185 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.290112    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f471851c-8007-47fd-9476-b87e00d2171e" (UID: "f471851c-8007-47fd-9476-b87e00d2171e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:50:37.388622 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.388583    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-oauth-config\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:37.388622 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.388616    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-service-ca\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:37.388622 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.388627    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-console-config\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:37.388871 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.388636    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f471851c-8007-47fd-9476-b87e00d2171e-console-serving-cert\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:37.388871 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.388647    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktl6z\" (UniqueName: \"kubernetes.io/projected/f471851c-8007-47fd-9476-b87e00d2171e-kube-api-access-ktl6z\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:37.388871 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.388665    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-trusted-ca-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:37.388871 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.388673    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f471851c-8007-47fd-9476-b87e00d2171e-oauth-serving-cert\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:50:37.905928 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.905900    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dbb778c5f-8lbw8_f471851c-8007-47fd-9476-b87e00d2171e/console/0.log"
May 28 18:50:37.906322 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.905943    2572 generic.go:358] "Generic (PLEG): container finished" podID="f471851c-8007-47fd-9476-b87e00d2171e" containerID="153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2" exitCode=2
May 28 18:50:37.906322 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.906019    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dbb778c5f-8lbw8"
May 28 18:50:37.906322 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.906037    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbb778c5f-8lbw8" event={"ID":"f471851c-8007-47fd-9476-b87e00d2171e","Type":"ContainerDied","Data":"153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2"}
May 28 18:50:37.906322 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.906080    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dbb778c5f-8lbw8" event={"ID":"f471851c-8007-47fd-9476-b87e00d2171e","Type":"ContainerDied","Data":"2d5909c9988203a16946bfac4d1a87a105b424a8b67b3cb35fa74d5d4f8564d2"}
May 28 18:50:37.906322 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.906096    2572 scope.go:117] "RemoveContainer" containerID="153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2"
May 28 18:50:37.914537 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.914494    2572 scope.go:117] "RemoveContainer" containerID="153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2"
May 28 18:50:37.914779 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:50:37.914759    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2\": container with ID starting with 153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2 not found: ID does not exist" containerID="153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2"
May 28 18:50:37.914823 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.914788    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2"} err="failed to get container status \"153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2\": rpc error: code = NotFound desc = could not find container \"153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2\": container with ID starting with 153d3ee55a785a5d44f8dbf129d0be205ffd0364884a437e0df4a1c93d3c83f2 not found: ID does not exist"
May 28 18:50:37.926625 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.926598    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dbb778c5f-8lbw8"]
May 28 18:50:37.933866 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:37.933841    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dbb778c5f-8lbw8"]
May 28 18:50:38.060993 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:38.060954    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f471851c-8007-47fd-9476-b87e00d2171e" path="/var/lib/kubelet/pods/f471851c-8007-47fd-9476-b87e00d2171e/volumes"
May 28 18:50:55.951904 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:55.951878    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 18:50:55.953162 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:55.953132    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 18:50:55.957907 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:50:55.957886    2572 kubelet.go:1628] "Image garbage collection succeeded"
May 28 18:51:10.703655 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.703620    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"]
May 28 18:51:10.706257 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.703923    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f471851c-8007-47fd-9476-b87e00d2171e" containerName="console"
May 28 18:51:10.706257 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.703934    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f471851c-8007-47fd-9476-b87e00d2171e" containerName="console"
May 28 18:51:10.706257 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.703987    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="f471851c-8007-47fd-9476-b87e00d2171e" containerName="console"
May 28 18:51:10.706955 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.706939    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:10.708940 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.708917    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8q4pz\""
May 28 18:51:10.709056 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.708943    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 18:51:10.709056 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.708946    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 18:51:10.714859 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.714837    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"]
May 28 18:51:10.839218 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.839182    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-892v9\" (UniqueName: \"kubernetes.io/projected/57dd1000-3dcf-415a-800b-9b9b2b449dfb-kube-api-access-892v9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:10.839406 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.839244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:10.839406 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.839342    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:10.940695 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.940655    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:10.940874 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.940721    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:10.940874 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.940748    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-892v9\" (UniqueName: \"kubernetes.io/projected/57dd1000-3dcf-415a-800b-9b9b2b449dfb-kube-api-access-892v9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:10.941032 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.941014    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:10.941071 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.941042    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:10.949135 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:10.949103    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-892v9\" (UniqueName: \"kubernetes.io/projected/57dd1000-3dcf-415a-800b-9b9b2b449dfb-kube-api-access-892v9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:11.016969 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:11.016886    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:11.140052 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:11.140009    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"]
May 28 18:51:11.143846 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:51:11.143819    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57dd1000_3dcf_415a_800b_9b9b2b449dfb.slice/crio-59b9d1e89b0b59cd1c27b7afa31ba19ce7ef54988dc6eac61f245ac562b2c250 WatchSource:0}: Error finding container 59b9d1e89b0b59cd1c27b7afa31ba19ce7ef54988dc6eac61f245ac562b2c250: Status 404 returned error can't find the container with id 59b9d1e89b0b59cd1c27b7afa31ba19ce7ef54988dc6eac61f245ac562b2c250
May 28 18:51:11.145809 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:11.145791    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:51:12.003918 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:12.003873    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd" event={"ID":"57dd1000-3dcf-415a-800b-9b9b2b449dfb","Type":"ContainerStarted","Data":"59b9d1e89b0b59cd1c27b7afa31ba19ce7ef54988dc6eac61f245ac562b2c250"}
May 28 18:51:17.020897 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:17.020862    2572 generic.go:358] "Generic (PLEG): container finished" podID="57dd1000-3dcf-415a-800b-9b9b2b449dfb" containerID="d943814f45259be2d3f77474a3023811cde6868ab51530a0606313868918fb18" exitCode=0
May 28 18:51:17.021343 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:17.020933    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd" event={"ID":"57dd1000-3dcf-415a-800b-9b9b2b449dfb","Type":"ContainerDied","Data":"d943814f45259be2d3f77474a3023811cde6868ab51530a0606313868918fb18"}
May 28 18:51:20.030617 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:20.030580    2572 generic.go:358] "Generic (PLEG): container finished" podID="57dd1000-3dcf-415a-800b-9b9b2b449dfb" containerID="84703ebd0bc2fa6c5159c634d31eaa8883bd9204ba5eaf3f4cc0e82eedde4628" exitCode=0
May 28 18:51:20.030984 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:20.030636    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd" event={"ID":"57dd1000-3dcf-415a-800b-9b9b2b449dfb","Type":"ContainerDied","Data":"84703ebd0bc2fa6c5159c634d31eaa8883bd9204ba5eaf3f4cc0e82eedde4628"}
May 28 18:51:27.053610 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:27.053568    2572 generic.go:358] "Generic (PLEG): container finished" podID="57dd1000-3dcf-415a-800b-9b9b2b449dfb" containerID="e05012743e7934d7586854d8503a84d4fb6d3defb22ba9c678c3b0c5384362a9" exitCode=0
May 28 18:51:27.053610 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:27.053614    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd" event={"ID":"57dd1000-3dcf-415a-800b-9b9b2b449dfb","Type":"ContainerDied","Data":"e05012743e7934d7586854d8503a84d4fb6d3defb22ba9c678c3b0c5384362a9"}
May 28 18:51:28.181484 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:28.181459    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:28.296826 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:28.296799    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-892v9\" (UniqueName: \"kubernetes.io/projected/57dd1000-3dcf-415a-800b-9b9b2b449dfb-kube-api-access-892v9\") pod \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") "
May 28 18:51:28.296984 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:28.296849    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-bundle\") pod \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") "
May 28 18:51:28.296984 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:28.296924    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-util\") pod \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\" (UID: \"57dd1000-3dcf-415a-800b-9b9b2b449dfb\") "
May 28 18:51:28.297536 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:28.297508    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-bundle" (OuterVolumeSpecName: "bundle") pod "57dd1000-3dcf-415a-800b-9b9b2b449dfb" (UID: "57dd1000-3dcf-415a-800b-9b9b2b449dfb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:51:28.298856 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:28.298826    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57dd1000-3dcf-415a-800b-9b9b2b449dfb-kube-api-access-892v9" (OuterVolumeSpecName: "kube-api-access-892v9") pod "57dd1000-3dcf-415a-800b-9b9b2b449dfb" (UID: "57dd1000-3dcf-415a-800b-9b9b2b449dfb"). InnerVolumeSpecName "kube-api-access-892v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:51:28.302257 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:28.302224    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-util" (OuterVolumeSpecName: "util") pod "57dd1000-3dcf-415a-800b-9b9b2b449dfb" (UID: "57dd1000-3dcf-415a-800b-9b9b2b449dfb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:51:28.397525 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:28.397497    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-892v9\" (UniqueName: \"kubernetes.io/projected/57dd1000-3dcf-415a-800b-9b9b2b449dfb-kube-api-access-892v9\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:51:28.397525 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:28.397521    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:51:28.397525 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:28.397531    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57dd1000-3dcf-415a-800b-9b9b2b449dfb-util\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:51:29.060717 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:29.060685    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd" event={"ID":"57dd1000-3dcf-415a-800b-9b9b2b449dfb","Type":"ContainerDied","Data":"59b9d1e89b0b59cd1c27b7afa31ba19ce7ef54988dc6eac61f245ac562b2c250"}
May 28 18:51:29.060717 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:29.060705    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9plkd"
May 28 18:51:29.060717 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:29.060715    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59b9d1e89b0b59cd1c27b7afa31ba19ce7ef54988dc6eac61f245ac562b2c250"
May 28 18:51:33.655482 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.655445    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz"]
May 28 18:51:33.655927 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.655907    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57dd1000-3dcf-415a-800b-9b9b2b449dfb" containerName="pull"
May 28 18:51:33.655927 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.655927    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="57dd1000-3dcf-415a-800b-9b9b2b449dfb" containerName="pull"
May 28 18:51:33.656147 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.655942    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57dd1000-3dcf-415a-800b-9b9b2b449dfb" containerName="util"
May 28 18:51:33.656147 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.655952    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="57dd1000-3dcf-415a-800b-9b9b2b449dfb" containerName="util"
May 28 18:51:33.656147 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.655979    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57dd1000-3dcf-415a-800b-9b9b2b449dfb" containerName="extract"
May 28 18:51:33.656147 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.655987    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="57dd1000-3dcf-415a-800b-9b9b2b449dfb" containerName="extract"
May 28 18:51:33.656147 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.656057    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="57dd1000-3dcf-415a-800b-9b9b2b449dfb" containerName="extract"
May 28 18:51:33.661784 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.661769    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz"
May 28 18:51:33.663947 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.663926    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 28 18:51:33.664052 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.663970    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 28 18:51:33.664052 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.664044    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cqc8k\""
May 28 18:51:33.671770 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.671750    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz"]
May 28 18:51:33.843739 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.843706    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm8mp\" (UniqueName: \"kubernetes.io/projected/124a1880-0848-4e38-b5a8-bc181296392b-kube-api-access-hm8mp\") pod \"cert-manager-operator-controller-manager-54b9655956-zw8cz\" (UID: \"124a1880-0848-4e38-b5a8-bc181296392b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz"
May 28 18:51:33.843899 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.843743    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/124a1880-0848-4e38-b5a8-bc181296392b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zw8cz\" (UID: \"124a1880-0848-4e38-b5a8-bc181296392b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz"
May 28 18:51:33.944241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.944199    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hm8mp\" (UniqueName: \"kubernetes.io/projected/124a1880-0848-4e38-b5a8-bc181296392b-kube-api-access-hm8mp\") pod \"cert-manager-operator-controller-manager-54b9655956-zw8cz\" (UID: \"124a1880-0848-4e38-b5a8-bc181296392b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz"
May 28 18:51:33.944241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.944245    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/124a1880-0848-4e38-b5a8-bc181296392b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zw8cz\" (UID: \"124a1880-0848-4e38-b5a8-bc181296392b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz"
May 28 18:51:33.944675 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.944648    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/124a1880-0848-4e38-b5a8-bc181296392b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zw8cz\" (UID: \"124a1880-0848-4e38-b5a8-bc181296392b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz"
May 28 18:51:33.952049 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.952029    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm8mp\" (UniqueName: \"kubernetes.io/projected/124a1880-0848-4e38-b5a8-bc181296392b-kube-api-access-hm8mp\") pod \"cert-manager-operator-controller-manager-54b9655956-zw8cz\" (UID: \"124a1880-0848-4e38-b5a8-bc181296392b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz"
May 28 18:51:33.970976 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:33.970956    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz"
May 28 18:51:34.100481 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:34.099886    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz"]
May 28 18:51:35.080331 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:35.080297    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz" event={"ID":"124a1880-0848-4e38-b5a8-bc181296392b","Type":"ContainerStarted","Data":"e64b76953f6deeb82027f3c6d978aa8feb5ec461f944a2739d92dfa180d90435"}
May 28 18:51:36.084553 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:36.084518    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz" event={"ID":"124a1880-0848-4e38-b5a8-bc181296392b","Type":"ContainerStarted","Data":"e5fcffc11298f3289539903e6ec484e81f502e061ba7188a86df70c4cfb2f0bc"}
May 28 18:51:36.104922 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:36.104867    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw8cz" podStartSLOduration=1.540003692 podStartE2EDuration="3.104850113s" podCreationTimestamp="2026-05-28 18:51:33 +0000 UTC" firstStartedPulling="2026-05-28 18:51:34.106822446 +0000 UTC m=+338.666597395" lastFinishedPulling="2026-05-28 18:51:35.67166887 +0000 UTC m=+340.231443816" observedRunningTime="2026-05-28 18:51:36.103600931 +0000 UTC m=+340.663375901" watchObservedRunningTime="2026-05-28 18:51:36.104850113 +0000 UTC m=+340.664625082"
May 28 18:51:37.331205 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.331170    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"]
May 28 18:51:37.334751 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.334735    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:37.336916 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.336894    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8q4pz\""
May 28 18:51:37.337088 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.336954    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 18:51:37.337088 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.336976    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 18:51:37.341693 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.341538    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"]
May 28 18:51:37.473890 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.473858    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:37.474063 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.473907    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpl2c\" (UniqueName: \"kubernetes.io/projected/137a333c-e19a-47ff-9030-83217705b133-kube-api-access-cpl2c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:37.474063 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.473976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:37.574880 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.574853    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:37.575060 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.574896    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpl2c\" (UniqueName: \"kubernetes.io/projected/137a333c-e19a-47ff-9030-83217705b133-kube-api-access-cpl2c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:37.575060 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.574950    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:37.575277 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.575259    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:37.575354 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.575327    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:37.586615 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.586559    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpl2c\" (UniqueName: \"kubernetes.io/projected/137a333c-e19a-47ff-9030-83217705b133-kube-api-access-cpl2c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:37.644782 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.644760    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:37.766093 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:37.766071    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"]
May 28 18:51:37.768838 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:51:37.768799    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod137a333c_e19a_47ff_9030_83217705b133.slice/crio-ae15124653556ff47deff22517b58a2348cf6c1c9e860fcdebd8587ca77415fb WatchSource:0}: Error finding container ae15124653556ff47deff22517b58a2348cf6c1c9e860fcdebd8587ca77415fb: Status 404 returned error can't find the container with id ae15124653556ff47deff22517b58a2348cf6c1c9e860fcdebd8587ca77415fb
May 28 18:51:38.092764 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:38.092693    2572 generic.go:358] "Generic (PLEG): container finished" podID="137a333c-e19a-47ff-9030-83217705b133" containerID="1eb26eb36922bfcc2b552233ff45031571bd17d7beea39695576ff2e17034e22" exitCode=0
May 28 18:51:38.092764 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:38.092751    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc" event={"ID":"137a333c-e19a-47ff-9030-83217705b133","Type":"ContainerDied","Data":"1eb26eb36922bfcc2b552233ff45031571bd17d7beea39695576ff2e17034e22"}
May 28 18:51:38.092927 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:38.092776    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc" event={"ID":"137a333c-e19a-47ff-9030-83217705b133","Type":"ContainerStarted","Data":"ae15124653556ff47deff22517b58a2348cf6c1c9e860fcdebd8587ca77415fb"}
May 28 18:51:40.312185 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.312160    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-brtl7"]
May 28 18:51:40.316572 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.316556    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-brtl7"
May 28 18:51:40.318707 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.318686    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 18:51:40.318800 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.318772    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9g4lv\""
May 28 18:51:40.319321 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.319307    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 18:51:40.322173 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.322150    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-brtl7"]
May 28 18:51:40.398062 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.398019    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0d900d0-6273-45a1-8953-ef6e05d677d9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-brtl7\" (UID: \"a0d900d0-6273-45a1-8953-ef6e05d677d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-brtl7"
May 28 18:51:40.398235 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.398136    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v27qn\" (UniqueName: \"kubernetes.io/projected/a0d900d0-6273-45a1-8953-ef6e05d677d9-kube-api-access-v27qn\") pod \"cert-manager-cainjector-68b757865b-brtl7\" (UID: \"a0d900d0-6273-45a1-8953-ef6e05d677d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-brtl7"
May 28 18:51:40.499014 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.498975    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v27qn\" (UniqueName: \"kubernetes.io/projected/a0d900d0-6273-45a1-8953-ef6e05d677d9-kube-api-access-v27qn\") pod \"cert-manager-cainjector-68b757865b-brtl7\" (UID: \"a0d900d0-6273-45a1-8953-ef6e05d677d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-brtl7"
May 28 18:51:40.499191 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.499073    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0d900d0-6273-45a1-8953-ef6e05d677d9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-brtl7\" (UID: \"a0d900d0-6273-45a1-8953-ef6e05d677d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-brtl7"
May 28 18:51:40.506061 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.506029    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0d900d0-6273-45a1-8953-ef6e05d677d9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-brtl7\" (UID: \"a0d900d0-6273-45a1-8953-ef6e05d677d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-brtl7"
May 28 18:51:40.506286 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.506267    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v27qn\" (UniqueName: \"kubernetes.io/projected/a0d900d0-6273-45a1-8953-ef6e05d677d9-kube-api-access-v27qn\") pod \"cert-manager-cainjector-68b757865b-brtl7\" (UID: \"a0d900d0-6273-45a1-8953-ef6e05d677d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-brtl7"
May 28 18:51:40.648566 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.648534    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-brtl7"
May 28 18:51:40.767850 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:40.767727    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-brtl7"]
May 28 18:51:40.770282 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:51:40.770255    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0d900d0_6273_45a1_8953_ef6e05d677d9.slice/crio-6f540a4e44caca85749fe77577bb226ecb568f555469f004ea3691036ef0e74d WatchSource:0}: Error finding container 6f540a4e44caca85749fe77577bb226ecb568f555469f004ea3691036ef0e74d: Status 404 returned error can't find the container with id 6f540a4e44caca85749fe77577bb226ecb568f555469f004ea3691036ef0e74d
May 28 18:51:41.104336 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:41.104294    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-brtl7" event={"ID":"a0d900d0-6273-45a1-8953-ef6e05d677d9","Type":"ContainerStarted","Data":"6f540a4e44caca85749fe77577bb226ecb568f555469f004ea3691036ef0e74d"}
May 28 18:51:41.106099 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:41.106068    2572 generic.go:358] "Generic (PLEG): container finished" podID="137a333c-e19a-47ff-9030-83217705b133" containerID="67fce9c39b297ae62b9747ed74d2ad45e2a789ea8d7ea226b5afa09cdb53c36c" exitCode=0
May 28 18:51:41.106244 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:41.106135    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc" event={"ID":"137a333c-e19a-47ff-9030-83217705b133","Type":"ContainerDied","Data":"67fce9c39b297ae62b9747ed74d2ad45e2a789ea8d7ea226b5afa09cdb53c36c"}
May 28 18:51:42.111358 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:42.111312    2572 generic.go:358] "Generic (PLEG): container finished" podID="137a333c-e19a-47ff-9030-83217705b133" containerID="dc27a3b2df9b50c079b98f7526811d89fa9135dc54ea2f7cfcd075902157a0ab" exitCode=0
May 28 18:51:42.111878 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:42.111434    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc" event={"ID":"137a333c-e19a-47ff-9030-83217705b133","Type":"ContainerDied","Data":"dc27a3b2df9b50c079b98f7526811d89fa9135dc54ea2f7cfcd075902157a0ab"}
May 28 18:51:43.116397 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.116355    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-brtl7" event={"ID":"a0d900d0-6273-45a1-8953-ef6e05d677d9","Type":"ContainerStarted","Data":"e52be04c716bb1dd4a8af9432672e801cc268b9c058115c5dfa5dcd425df68ac"}
May 28 18:51:43.134295 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.134180    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-brtl7" podStartSLOduration=1.02854994 podStartE2EDuration="3.134161574s" podCreationTimestamp="2026-05-28 18:51:40 +0000 UTC" firstStartedPulling="2026-05-28 18:51:40.772115877 +0000 UTC m=+345.331890823" lastFinishedPulling="2026-05-28 18:51:42.877727506 +0000 UTC m=+347.437502457" observedRunningTime="2026-05-28 18:51:43.131657093 +0000 UTC m=+347.691432061" watchObservedRunningTime="2026-05-28 18:51:43.134161574 +0000 UTC m=+347.693936543"
May 28 18:51:43.271790 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.271762    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:43.319860 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.319829    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpl2c\" (UniqueName: \"kubernetes.io/projected/137a333c-e19a-47ff-9030-83217705b133-kube-api-access-cpl2c\") pod \"137a333c-e19a-47ff-9030-83217705b133\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") "
May 28 18:51:43.320012 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.319908    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-bundle\") pod \"137a333c-e19a-47ff-9030-83217705b133\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") "
May 28 18:51:43.320012 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.319981    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-util\") pod \"137a333c-e19a-47ff-9030-83217705b133\" (UID: \"137a333c-e19a-47ff-9030-83217705b133\") "
May 28 18:51:43.320299 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.320272    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-bundle" (OuterVolumeSpecName: "bundle") pod "137a333c-e19a-47ff-9030-83217705b133" (UID: "137a333c-e19a-47ff-9030-83217705b133"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:51:43.321927 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.321904    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/137a333c-e19a-47ff-9030-83217705b133-kube-api-access-cpl2c" (OuterVolumeSpecName: "kube-api-access-cpl2c") pod "137a333c-e19a-47ff-9030-83217705b133" (UID: "137a333c-e19a-47ff-9030-83217705b133"). InnerVolumeSpecName "kube-api-access-cpl2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:51:43.324203 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.324167    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-util" (OuterVolumeSpecName: "util") pod "137a333c-e19a-47ff-9030-83217705b133" (UID: "137a333c-e19a-47ff-9030-83217705b133"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:51:43.420770 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.420685    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpl2c\" (UniqueName: \"kubernetes.io/projected/137a333c-e19a-47ff-9030-83217705b133-kube-api-access-cpl2c\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:51:43.420770 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.420719    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:51:43.420770 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:43.420732    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/137a333c-e19a-47ff-9030-83217705b133-util\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:51:44.121747 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.121711    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc" event={"ID":"137a333c-e19a-47ff-9030-83217705b133","Type":"ContainerDied","Data":"ae15124653556ff47deff22517b58a2348cf6c1c9e860fcdebd8587ca77415fb"}
May 28 18:51:44.121747 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.121741    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bmfc"
May 28 18:51:44.121747 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.121746    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae15124653556ff47deff22517b58a2348cf6c1c9e860fcdebd8587ca77415fb"
May 28 18:51:44.716420 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.716369    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-665g9"]
May 28 18:51:44.716803 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.716785    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137a333c-e19a-47ff-9030-83217705b133" containerName="pull"
May 28 18:51:44.716954 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.716805    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="137a333c-e19a-47ff-9030-83217705b133" containerName="pull"
May 28 18:51:44.716954 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.716817    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137a333c-e19a-47ff-9030-83217705b133" containerName="extract"
May 28 18:51:44.716954 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.716824    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="137a333c-e19a-47ff-9030-83217705b133" containerName="extract"
May 28 18:51:44.716954 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.716848    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="137a333c-e19a-47ff-9030-83217705b133" containerName="util"
May 28 18:51:44.716954 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.716857    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="137a333c-e19a-47ff-9030-83217705b133" containerName="util"
May 28 18:51:44.716954 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.716946    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="137a333c-e19a-47ff-9030-83217705b133" containerName="extract"
May 28 18:51:44.723083 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.723057    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-665g9"
May 28 18:51:44.725076 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.725046    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-29qm7\""
May 28 18:51:44.725730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.725711    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-665g9"]
May 28 18:51:44.732071 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.732051    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-665g9\" (UID: \"b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-665g9"
May 28 18:51:44.732195 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.732088    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln4wm\" (UniqueName: \"kubernetes.io/projected/b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d-kube-api-access-ln4wm\") pod \"cert-manager-webhook-587ccfb98-665g9\" (UID: \"b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-665g9"
May 28 18:51:44.833231 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.833193    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-665g9\" (UID: \"b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-665g9"
May 28 18:51:44.833409 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.833239    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ln4wm\" (UniqueName: \"kubernetes.io/projected/b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d-kube-api-access-ln4wm\") pod \"cert-manager-webhook-587ccfb98-665g9\" (UID: \"b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-665g9"
May 28 18:51:44.841046 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.841025    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-665g9\" (UID: \"b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-665g9"
May 28 18:51:44.841232 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:44.841211    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln4wm\" (UniqueName: \"kubernetes.io/projected/b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d-kube-api-access-ln4wm\") pod \"cert-manager-webhook-587ccfb98-665g9\" (UID: \"b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-665g9"
May 28 18:51:45.032926 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:45.032843    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-665g9"
May 28 18:51:45.158836 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:45.158813    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-665g9"]
May 28 18:51:45.160929 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:51:45.160900    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3b556ba_85f4_4b8b_8ad8_42a3b4aca52d.slice/crio-bacc5cc0bb956d16f10c5f2a3bcfcd9bc58d1cea0f65739dd0458fc81535942c WatchSource:0}: Error finding container bacc5cc0bb956d16f10c5f2a3bcfcd9bc58d1cea0f65739dd0458fc81535942c: Status 404 returned error can't find the container with id bacc5cc0bb956d16f10c5f2a3bcfcd9bc58d1cea0f65739dd0458fc81535942c
May 28 18:51:46.129112 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:46.129030    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-665g9" event={"ID":"b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d","Type":"ContainerStarted","Data":"2ef89ee8aef2fcd2467f6034dbdadd5b10aa525441da26c3427f5522e17c69a3"}
May 28 18:51:46.129112 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:46.129064    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-665g9" event={"ID":"b3b556ba-85f4-4b8b-8ad8-42a3b4aca52d","Type":"ContainerStarted","Data":"bacc5cc0bb956d16f10c5f2a3bcfcd9bc58d1cea0f65739dd0458fc81535942c"}
May 28 18:51:46.129356 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:46.129110    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-665g9"
May 28 18:51:46.143313 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:46.143268    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-665g9" podStartSLOduration=2.143254754 podStartE2EDuration="2.143254754s" podCreationTimestamp="2026-05-28 18:51:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:51:46.142447844 +0000 UTC m=+350.702222816" watchObservedRunningTime="2026-05-28 18:51:46.143254754 +0000 UTC m=+350.703029718"
May 28 18:51:50.539851 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.539820    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7"]
May 28 18:51:50.544112 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.544093    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7"
May 28 18:51:50.545994 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.545974    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 18:51:50.546522 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.546489    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 18:51:50.546646 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.546493    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zh249\""
May 28 18:51:50.549375 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.549353    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7"]
May 28 18:51:50.578402 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.578352    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnsw5\" (UniqueName: \"kubernetes.io/projected/8a23f292-9d15-4ec4-90d9-73cfa37587ce-kube-api-access-pnsw5\") pod \"openshift-lws-operator-bfc7f696d-wq9n7\" (UID: \"8a23f292-9d15-4ec4-90d9-73cfa37587ce\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7"
May 28 18:51:50.578550 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.578418    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a23f292-9d15-4ec4-90d9-73cfa37587ce-tmp\") pod \"openshift-lws-operator-bfc7f696d-wq9n7\" (UID: \"8a23f292-9d15-4ec4-90d9-73cfa37587ce\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7"
May 28 18:51:50.679808 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.679776    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsw5\" (UniqueName: \"kubernetes.io/projected/8a23f292-9d15-4ec4-90d9-73cfa37587ce-kube-api-access-pnsw5\") pod \"openshift-lws-operator-bfc7f696d-wq9n7\" (UID: \"8a23f292-9d15-4ec4-90d9-73cfa37587ce\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7"
May 28 18:51:50.679808 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.679815    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a23f292-9d15-4ec4-90d9-73cfa37587ce-tmp\") pod \"openshift-lws-operator-bfc7f696d-wq9n7\" (UID: \"8a23f292-9d15-4ec4-90d9-73cfa37587ce\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7"
May 28 18:51:50.680213 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.680194    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a23f292-9d15-4ec4-90d9-73cfa37587ce-tmp\") pod \"openshift-lws-operator-bfc7f696d-wq9n7\" (UID: \"8a23f292-9d15-4ec4-90d9-73cfa37587ce\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7"
May 28 18:51:50.687380 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.687353    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnsw5\" (UniqueName: \"kubernetes.io/projected/8a23f292-9d15-4ec4-90d9-73cfa37587ce-kube-api-access-pnsw5\") pod \"openshift-lws-operator-bfc7f696d-wq9n7\" (UID: \"8a23f292-9d15-4ec4-90d9-73cfa37587ce\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7"
May 28 18:51:50.860037 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.860012    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7"
May 28 18:51:50.990792 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:50.990758    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7"]
May 28 18:51:51.151372 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:51.151290    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7" event={"ID":"8a23f292-9d15-4ec4-90d9-73cfa37587ce","Type":"ContainerStarted","Data":"9ef7194b51a71df9b406a42135c3c02e78a7f7309df46481224e8c75cc6b7ed6"}
May 28 18:51:52.135489 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:52.135456    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-665g9"
May 28 18:51:53.158896 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:53.158863    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7" event={"ID":"8a23f292-9d15-4ec4-90d9-73cfa37587ce","Type":"ContainerStarted","Data":"3c6cfb12f8b267a59cb78218d3f3763a293b1c6c3fad95cc42242afa631ca851"}
May 28 18:51:53.173690 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:53.173639    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-wq9n7" podStartSLOduration=1.137644649 podStartE2EDuration="3.173625957s" podCreationTimestamp="2026-05-28 18:51:50 +0000 UTC" firstStartedPulling="2026-05-28 18:51:51.000159936 +0000 UTC m=+355.559934905" lastFinishedPulling="2026-05-28 18:51:53.036141267 +0000 UTC m=+357.595916213" observedRunningTime="2026-05-28 18:51:53.172706593 +0000 UTC m=+357.732481551" watchObservedRunningTime="2026-05-28 18:51:53.173625957 +0000 UTC m=+357.733400924"
May 28 18:51:56.114589 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.114561    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"]
May 28 18:51:56.163761 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.163732    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"]
May 28 18:51:56.163898 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.163843    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:51:56.165820 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.165792    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 18:51:56.165972 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.165885    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 18:51:56.166373 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.166355    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8q4pz\""
May 28 18:51:56.226953 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.226924    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sjzb\" (UniqueName: \"kubernetes.io/projected/8f9766c3-00c0-4527-9dae-76223687f7a6-kube-api-access-6sjzb\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:51:56.227093 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.226957    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:51:56.227093 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.226977    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:51:56.328294 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.328263    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6sjzb\" (UniqueName: \"kubernetes.io/projected/8f9766c3-00c0-4527-9dae-76223687f7a6-kube-api-access-6sjzb\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:51:56.328436 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.328301    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:51:56.328436 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.328332    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:51:56.328664 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.328639    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:51:56.328705 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.328680    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:51:56.336037 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.336014    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sjzb\" (UniqueName: \"kubernetes.io/projected/8f9766c3-00c0-4527-9dae-76223687f7a6-kube-api-access-6sjzb\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:51:56.473422 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.473335    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:51:56.596740 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:56.596700    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"]
May 28 18:51:56.598739 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:51:56.598712    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9766c3_00c0_4527_9dae_76223687f7a6.slice/crio-960e3a876265cf6984d7a53725818ee39c83367e38c27a2a1ec9d65322bea356 WatchSource:0}: Error finding container 960e3a876265cf6984d7a53725818ee39c83367e38c27a2a1ec9d65322bea356: Status 404 returned error can't find the container with id 960e3a876265cf6984d7a53725818ee39c83367e38c27a2a1ec9d65322bea356
May 28 18:51:57.173256 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:57.173220    2572 generic.go:358] "Generic (PLEG): container finished" podID="8f9766c3-00c0-4527-9dae-76223687f7a6" containerID="ffbb354b9d7393f6c6c45ca7d116404ed6338485b6ee5d69e3cf04ac4ac53d34" exitCode=0
May 28 18:51:57.173749 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:57.173284    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md" event={"ID":"8f9766c3-00c0-4527-9dae-76223687f7a6","Type":"ContainerDied","Data":"ffbb354b9d7393f6c6c45ca7d116404ed6338485b6ee5d69e3cf04ac4ac53d34"}
May 28 18:51:57.173749 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:57.173310    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md" event={"ID":"8f9766c3-00c0-4527-9dae-76223687f7a6","Type":"ContainerStarted","Data":"960e3a876265cf6984d7a53725818ee39c83367e38c27a2a1ec9d65322bea356"}
May 28 18:51:58.178547 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:58.178517    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md" event={"ID":"8f9766c3-00c0-4527-9dae-76223687f7a6","Type":"ContainerStarted","Data":"1b78d904fb799b695b4b4c8769000e4fc30eaf003d270967485d36f185d5949e"}
May 28 18:51:59.183349 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:59.183314    2572 generic.go:358] "Generic (PLEG): container finished" podID="8f9766c3-00c0-4527-9dae-76223687f7a6" containerID="1b78d904fb799b695b4b4c8769000e4fc30eaf003d270967485d36f185d5949e" exitCode=0
May 28 18:51:59.183776 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:51:59.183397    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md" event={"ID":"8f9766c3-00c0-4527-9dae-76223687f7a6","Type":"ContainerDied","Data":"1b78d904fb799b695b4b4c8769000e4fc30eaf003d270967485d36f185d5949e"}
May 28 18:52:00.187985 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:00.187952    2572 generic.go:358] "Generic (PLEG): container finished" podID="8f9766c3-00c0-4527-9dae-76223687f7a6" containerID="7dd867bc227957d3c48320fef96321c50a582b3ada207f74a4bb02e242cdaa26" exitCode=0
May 28 18:52:00.188364 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:00.188034    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md" event={"ID":"8f9766c3-00c0-4527-9dae-76223687f7a6","Type":"ContainerDied","Data":"7dd867bc227957d3c48320fef96321c50a582b3ada207f74a4bb02e242cdaa26"}
May 28 18:52:01.314121 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:01.314098    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:52:01.364295 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:01.364275    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-util\") pod \"8f9766c3-00c0-4527-9dae-76223687f7a6\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") "
May 28 18:52:01.364457 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:01.364309    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sjzb\" (UniqueName: \"kubernetes.io/projected/8f9766c3-00c0-4527-9dae-76223687f7a6-kube-api-access-6sjzb\") pod \"8f9766c3-00c0-4527-9dae-76223687f7a6\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") "
May 28 18:52:01.364457 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:01.364356    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-bundle\") pod \"8f9766c3-00c0-4527-9dae-76223687f7a6\" (UID: \"8f9766c3-00c0-4527-9dae-76223687f7a6\") "
May 28 18:52:01.365103 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:01.365071    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-bundle" (OuterVolumeSpecName: "bundle") pod "8f9766c3-00c0-4527-9dae-76223687f7a6" (UID: "8f9766c3-00c0-4527-9dae-76223687f7a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:52:01.366275 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:01.366255    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f9766c3-00c0-4527-9dae-76223687f7a6-kube-api-access-6sjzb" (OuterVolumeSpecName: "kube-api-access-6sjzb") pod "8f9766c3-00c0-4527-9dae-76223687f7a6" (UID: "8f9766c3-00c0-4527-9dae-76223687f7a6"). InnerVolumeSpecName "kube-api-access-6sjzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:52:01.369613 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:01.369590    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-util" (OuterVolumeSpecName: "util") pod "8f9766c3-00c0-4527-9dae-76223687f7a6" (UID: "8f9766c3-00c0-4527-9dae-76223687f7a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:52:01.465060 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:01.464999    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-util\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:01.465060 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:01.465022    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sjzb\" (UniqueName: \"kubernetes.io/projected/8f9766c3-00c0-4527-9dae-76223687f7a6-kube-api-access-6sjzb\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:01.465060 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:01.465033    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f9766c3-00c0-4527-9dae-76223687f7a6-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:02.196219 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:02.196195    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md"
May 28 18:52:02.196364 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:02.196189    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5hs5md" event={"ID":"8f9766c3-00c0-4527-9dae-76223687f7a6","Type":"ContainerDied","Data":"960e3a876265cf6984d7a53725818ee39c83367e38c27a2a1ec9d65322bea356"}
May 28 18:52:02.196364 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:02.196294    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="960e3a876265cf6984d7a53725818ee39c83367e38c27a2a1ec9d65322bea356"
May 28 18:52:15.342684 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.342652    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"]
May 28 18:52:15.343228 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.343161    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9766c3-00c0-4527-9dae-76223687f7a6" containerName="util"
May 28 18:52:15.343228 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.343179    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9766c3-00c0-4527-9dae-76223687f7a6" containerName="util"
May 28 18:52:15.343228 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.343203    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9766c3-00c0-4527-9dae-76223687f7a6" containerName="pull"
May 28 18:52:15.343228 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.343211    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9766c3-00c0-4527-9dae-76223687f7a6" containerName="pull"
May 28 18:52:15.343371 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.343232    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9766c3-00c0-4527-9dae-76223687f7a6" containerName="extract"
May 28 18:52:15.343371 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.343241    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9766c3-00c0-4527-9dae-76223687f7a6" containerName="extract"
May 28 18:52:15.343371 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.343293    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f9766c3-00c0-4527-9dae-76223687f7a6" containerName="extract"
May 28 18:52:15.347695 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.347670    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:15.349395 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.349362    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8q4pz\""
May 28 18:52:15.350211 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.350190    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 18:52:15.350320 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.350246    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 18:52:15.362675 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.362652    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"]
May 28 18:52:15.365979 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.365962    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"]
May 28 18:52:15.366072 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.366055    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:15.369172 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.369154    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 18:52:15.369520 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.369505    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 18:52:15.369968 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.369951    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 18:52:15.370553 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.370532    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gtp98\""
May 28 18:52:15.370823 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.370810    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 18:52:15.398556 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.398529    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"]
May 28 18:52:15.476346 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.476320    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r2s7\" (UniqueName: \"kubernetes.io/projected/fd4a1edc-9ba7-4332-a08b-a350d37ae7bb-kube-api-access-8r2s7\") pod \"opendatahub-operator-controller-manager-75cc899db8-f8kwm\" (UID: \"fd4a1edc-9ba7-4332-a08b-a350d37ae7bb\") " pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:15.476478 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.476350    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:15.476478 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.476379    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nbll\" (UniqueName: \"kubernetes.io/projected/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-kube-api-access-2nbll\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:15.476478 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.476436    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd4a1edc-9ba7-4332-a08b-a350d37ae7bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-75cc899db8-f8kwm\" (UID: \"fd4a1edc-9ba7-4332-a08b-a350d37ae7bb\") " pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:15.476478 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.476459    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fd4a1edc-9ba7-4332-a08b-a350d37ae7bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75cc899db8-f8kwm\" (UID: \"fd4a1edc-9ba7-4332-a08b-a350d37ae7bb\") " pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:15.476640 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.476524    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:15.577633 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.577604    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:15.577761 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.577659    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8r2s7\" (UniqueName: \"kubernetes.io/projected/fd4a1edc-9ba7-4332-a08b-a350d37ae7bb-kube-api-access-8r2s7\") pod \"opendatahub-operator-controller-manager-75cc899db8-f8kwm\" (UID: \"fd4a1edc-9ba7-4332-a08b-a350d37ae7bb\") " pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:15.577761 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.577686    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:15.577761 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.577729    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nbll\" (UniqueName: \"kubernetes.io/projected/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-kube-api-access-2nbll\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:15.577920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.577759    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd4a1edc-9ba7-4332-a08b-a350d37ae7bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-75cc899db8-f8kwm\" (UID: \"fd4a1edc-9ba7-4332-a08b-a350d37ae7bb\") " pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:15.577920 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.577797    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fd4a1edc-9ba7-4332-a08b-a350d37ae7bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75cc899db8-f8kwm\" (UID: \"fd4a1edc-9ba7-4332-a08b-a350d37ae7bb\") " pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:15.578050 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.578025    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:15.578113 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.578102    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:15.580134 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.580113    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fd4a1edc-9ba7-4332-a08b-a350d37ae7bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75cc899db8-f8kwm\" (UID: \"fd4a1edc-9ba7-4332-a08b-a350d37ae7bb\") " pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:15.580231 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.580145    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd4a1edc-9ba7-4332-a08b-a350d37ae7bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-75cc899db8-f8kwm\" (UID: \"fd4a1edc-9ba7-4332-a08b-a350d37ae7bb\") " pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:15.586090 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.586071    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r2s7\" (UniqueName: \"kubernetes.io/projected/fd4a1edc-9ba7-4332-a08b-a350d37ae7bb-kube-api-access-8r2s7\") pod \"opendatahub-operator-controller-manager-75cc899db8-f8kwm\" (UID: \"fd4a1edc-9ba7-4332-a08b-a350d37ae7bb\") " pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:15.586213 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.586190    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nbll\" (UniqueName: \"kubernetes.io/projected/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-kube-api-access-2nbll\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:15.657153 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.657094    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:15.677897 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.677874    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:15.791190 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.791162    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"]
May 28 18:52:15.793181 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:52:15.793158    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b1e1fc_2d0e_403e_91e1_228cd6e7d4e1.slice/crio-7d5ba415eeeaf0e95232f71908abd5c153aba364492586c4f9976489c1b23c67 WatchSource:0}: Error finding container 7d5ba415eeeaf0e95232f71908abd5c153aba364492586c4f9976489c1b23c67: Status 404 returned error can't find the container with id 7d5ba415eeeaf0e95232f71908abd5c153aba364492586c4f9976489c1b23c67
May 28 18:52:15.818757 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:15.818439    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"]
May 28 18:52:15.825575 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:52:15.825551    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4a1edc_9ba7_4332_a08b_a350d37ae7bb.slice/crio-37cb7d839309fd7a84c3a92859372626a9433cc0ebaaf81659bdccf081e31259 WatchSource:0}: Error finding container 37cb7d839309fd7a84c3a92859372626a9433cc0ebaaf81659bdccf081e31259: Status 404 returned error can't find the container with id 37cb7d839309fd7a84c3a92859372626a9433cc0ebaaf81659bdccf081e31259
May 28 18:52:16.242034 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.242004    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm" event={"ID":"fd4a1edc-9ba7-4332-a08b-a350d37ae7bb","Type":"ContainerStarted","Data":"37cb7d839309fd7a84c3a92859372626a9433cc0ebaaf81659bdccf081e31259"}
May 28 18:52:16.243177 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.243154    2572 generic.go:358] "Generic (PLEG): container finished" podID="b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" containerID="da9b6bdcdda3f0ee02ec4ee5fcbff4e540c54e15e05c7b3fb063b0dd919f6ecd" exitCode=0
May 28 18:52:16.243273 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.243215    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc" event={"ID":"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1","Type":"ContainerDied","Data":"da9b6bdcdda3f0ee02ec4ee5fcbff4e540c54e15e05c7b3fb063b0dd919f6ecd"}
May 28 18:52:16.243273 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.243230    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc" event={"ID":"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1","Type":"ContainerStarted","Data":"7d5ba415eeeaf0e95232f71908abd5c153aba364492586c4f9976489c1b23c67"}
May 28 18:52:16.866053 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.866017    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"]
May 28 18:52:16.870198 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.870004    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:16.873838 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.873817    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 28 18:52:16.874658 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.874042    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hz7vs\""
May 28 18:52:16.874849 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.874095    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 28 18:52:16.875092 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.875039    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 28 18:52:16.877065 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.877041    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"]
May 28 18:52:16.990167 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.990140    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fda05b17-f8e9-4479-8a6f-77949063108c-cert\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:16.990276 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.990210    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fda05b17-f8e9-4479-8a6f-77949063108c-metrics-cert\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:16.990276 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.990245    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fda05b17-f8e9-4479-8a6f-77949063108c-manager-config\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:16.990404 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:16.990306    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5ph9\" (UniqueName: \"kubernetes.io/projected/fda05b17-f8e9-4479-8a6f-77949063108c-kube-api-access-g5ph9\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:17.091923 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:17.091880    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fda05b17-f8e9-4479-8a6f-77949063108c-cert\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:17.092076 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:17.091951    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fda05b17-f8e9-4479-8a6f-77949063108c-metrics-cert\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:17.092076 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:17.091985    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fda05b17-f8e9-4479-8a6f-77949063108c-manager-config\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:17.092076 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:17.092059    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5ph9\" (UniqueName: \"kubernetes.io/projected/fda05b17-f8e9-4479-8a6f-77949063108c-kube-api-access-g5ph9\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:17.092759 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:17.092736    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fda05b17-f8e9-4479-8a6f-77949063108c-manager-config\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:17.094351 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:17.094331    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fda05b17-f8e9-4479-8a6f-77949063108c-cert\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:17.094465 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:17.094422    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fda05b17-f8e9-4479-8a6f-77949063108c-metrics-cert\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:17.101698 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:17.101679    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5ph9\" (UniqueName: \"kubernetes.io/projected/fda05b17-f8e9-4479-8a6f-77949063108c-kube-api-access-g5ph9\") pod \"lws-controller-manager-67dcd5d75d-scl2t\" (UID: \"fda05b17-f8e9-4479-8a6f-77949063108c\") " pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:17.187192 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:17.187122    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:17.249198 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:17.249156    2572 generic.go:358] "Generic (PLEG): container finished" podID="b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" containerID="88704d9fcefedfac713b49a423b1ae845174da4bf845c44c8006981421628fb9" exitCode=0
May 28 18:52:17.249393 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:17.249243    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc" event={"ID":"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1","Type":"ContainerDied","Data":"88704d9fcefedfac713b49a423b1ae845174da4bf845c44c8006981421628fb9"}
May 28 18:52:18.526862 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:18.526835    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"]
May 28 18:52:18.528080 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:52:18.528056    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda05b17_f8e9_4479_8a6f_77949063108c.slice/crio-03724da7d6c686b0adb972b9cbb201b1467760e79d58980bf0cdb0c953e9077e WatchSource:0}: Error finding container 03724da7d6c686b0adb972b9cbb201b1467760e79d58980bf0cdb0c953e9077e: Status 404 returned error can't find the container with id 03724da7d6c686b0adb972b9cbb201b1467760e79d58980bf0cdb0c953e9077e
May 28 18:52:19.258165 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:19.258131    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t" event={"ID":"fda05b17-f8e9-4479-8a6f-77949063108c","Type":"ContainerStarted","Data":"03724da7d6c686b0adb972b9cbb201b1467760e79d58980bf0cdb0c953e9077e"}
May 28 18:52:19.259826 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:19.259780    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm" event={"ID":"fd4a1edc-9ba7-4332-a08b-a350d37ae7bb","Type":"ContainerStarted","Data":"e3e33825e51ce8dad661a13c3ab6f979bbee8c8a8c3861cca7635b9758b0e36e"}
May 28 18:52:19.259973 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:19.259912    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:19.262043 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:19.262014    2572 generic.go:358] "Generic (PLEG): container finished" podID="b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" containerID="b6f61067f33adc42c52316d06a8ccdb15683165747ede48d8a4e48c1790ce9c6" exitCode=0
May 28 18:52:19.262170 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:19.262065    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc" event={"ID":"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1","Type":"ContainerDied","Data":"b6f61067f33adc42c52316d06a8ccdb15683165747ede48d8a4e48c1790ce9c6"}
May 28 18:52:19.280774 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:19.280723    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm" podStartSLOduration=1.657774285 podStartE2EDuration="4.280707035s" podCreationTimestamp="2026-05-28 18:52:15 +0000 UTC" firstStartedPulling="2026-05-28 18:52:15.827115527 +0000 UTC m=+380.386890473" lastFinishedPulling="2026-05-28 18:52:18.450048265 +0000 UTC m=+383.009823223" observedRunningTime="2026-05-28 18:52:19.279624799 +0000 UTC m=+383.839399768" watchObservedRunningTime="2026-05-28 18:52:19.280707035 +0000 UTC m=+383.840482005"
May 28 18:52:20.596374 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:20.596353    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:20.729457 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:20.729429    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-bundle\") pod \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") "
May 28 18:52:20.729620 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:20.729491    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-util\") pod \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") "
May 28 18:52:20.729620 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:20.729557    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nbll\" (UniqueName: \"kubernetes.io/projected/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-kube-api-access-2nbll\") pod \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\" (UID: \"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1\") "
May 28 18:52:20.730271 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:20.730239    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-bundle" (OuterVolumeSpecName: "bundle") pod "b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" (UID: "b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:52:20.731772 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:20.731751    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-kube-api-access-2nbll" (OuterVolumeSpecName: "kube-api-access-2nbll") pod "b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" (UID: "b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1"). InnerVolumeSpecName "kube-api-access-2nbll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:52:20.735544 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:20.735505    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-util" (OuterVolumeSpecName: "util") pod "b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" (UID: "b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:52:20.830592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:20.830505    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-util\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:20.830592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:20.830538    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nbll\" (UniqueName: \"kubernetes.io/projected/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-kube-api-access-2nbll\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:20.830592 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:20.830548    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:21.271490 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:21.271380    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t" event={"ID":"fda05b17-f8e9-4479-8a6f-77949063108c","Type":"ContainerStarted","Data":"b8df8d27e82e2ab3d181c81ab66398fada3503b3f020a616d7929eadaac8c08a"}
May 28 18:52:21.271663 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:21.271511    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:21.273025 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:21.272997    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc" event={"ID":"b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1","Type":"ContainerDied","Data":"7d5ba415eeeaf0e95232f71908abd5c153aba364492586c4f9976489c1b23c67"}
May 28 18:52:21.273164 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:21.273030    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d5ba415eeeaf0e95232f71908abd5c153aba364492586c4f9976489c1b23c67"
May 28 18:52:21.273164 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:21.273005    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9g8bhc"
May 28 18:52:21.287492 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:21.287442    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t" podStartSLOduration=3.178853579 podStartE2EDuration="5.287426279s" podCreationTimestamp="2026-05-28 18:52:16 +0000 UTC" firstStartedPulling="2026-05-28 18:52:18.530087261 +0000 UTC m=+383.089862207" lastFinishedPulling="2026-05-28 18:52:20.638659961 +0000 UTC m=+385.198434907" observedRunningTime="2026-05-28 18:52:21.28589762 +0000 UTC m=+385.845672587" watchObservedRunningTime="2026-05-28 18:52:21.287426279 +0000 UTC m=+385.847201249"
May 28 18:52:30.268166 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:30.268137    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75cc899db8-f8kwm"
May 28 18:52:32.216521 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.216490    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"]
May 28 18:52:32.216971 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.216838    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" containerName="pull"
May 28 18:52:32.216971 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.216848    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" containerName="pull"
May 28 18:52:32.216971 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.216859    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" containerName="util"
May 28 18:52:32.216971 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.216864    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" containerName="util"
May 28 18:52:32.216971 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.216878    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" containerName="extract"
May 28 18:52:32.216971 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.216883    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" containerName="extract"
May 28 18:52:32.216971 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.216934    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6b1e1fc-2d0e-403e-91e1-228cd6e7d4e1" containerName="extract"
May 28 18:52:32.219379 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.219362    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:32.221442 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.221417    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 18:52:32.221876 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.221848    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 18:52:32.221982 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.221854    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8q4pz\""
May 28 18:52:32.226094 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.226072    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"]
May 28 18:52:32.278111 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.278089    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67dcd5d75d-scl2t"
May 28 18:52:32.317089 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.317044    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:32.317241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.317094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:32.317241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.317150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkfml\" (UniqueName: \"kubernetes.io/projected/da7813d4-c05d-4553-a08d-dca43336fc1f-kube-api-access-tkfml\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:32.418009 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.417971    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:32.418184 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.418039    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:32.418184 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.418076    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tkfml\" (UniqueName: \"kubernetes.io/projected/da7813d4-c05d-4553-a08d-dca43336fc1f-kube-api-access-tkfml\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:32.418428 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.418404    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:32.418512 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.418449    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:32.433479 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.433455    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkfml\" (UniqueName: \"kubernetes.io/projected/da7813d4-c05d-4553-a08d-dca43336fc1f-kube-api-access-tkfml\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:32.530128 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.530061    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:32.660673 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:32.660637    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"]
May 28 18:52:32.662468 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:52:32.662438    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7813d4_c05d_4553_a08d_dca43336fc1f.slice/crio-40a2b7433298f040d9b6d0ac9d6c7cc4bbe30e86ebda7b860f5d4ce83656bde7 WatchSource:0}: Error finding container 40a2b7433298f040d9b6d0ac9d6c7cc4bbe30e86ebda7b860f5d4ce83656bde7: Status 404 returned error can't find the container with id 40a2b7433298f040d9b6d0ac9d6c7cc4bbe30e86ebda7b860f5d4ce83656bde7
May 28 18:52:33.318334 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:33.318299    2572 generic.go:358] "Generic (PLEG): container finished" podID="da7813d4-c05d-4553-a08d-dca43336fc1f" containerID="b1d4b21e599731f5eec0e779a124d0706a9cf48b776b3121a1725f1f3f442b57" exitCode=0
May 28 18:52:33.318827 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:33.318368    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68" event={"ID":"da7813d4-c05d-4553-a08d-dca43336fc1f","Type":"ContainerDied","Data":"b1d4b21e599731f5eec0e779a124d0706a9cf48b776b3121a1725f1f3f442b57"}
May 28 18:52:33.318827 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:33.318412    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68" event={"ID":"da7813d4-c05d-4553-a08d-dca43336fc1f","Type":"ContainerStarted","Data":"40a2b7433298f040d9b6d0ac9d6c7cc4bbe30e86ebda7b860f5d4ce83656bde7"}
May 28 18:52:34.323367 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:34.323332    2572 generic.go:358] "Generic (PLEG): container finished" podID="da7813d4-c05d-4553-a08d-dca43336fc1f" containerID="06dee719e9f77df54f1ea23bd22b9ae08ac4db8ea90cf1a34c927b3898ddbe40" exitCode=0
May 28 18:52:34.323739 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:34.323431    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68" event={"ID":"da7813d4-c05d-4553-a08d-dca43336fc1f","Type":"ContainerDied","Data":"06dee719e9f77df54f1ea23bd22b9ae08ac4db8ea90cf1a34c927b3898ddbe40"}
May 28 18:52:35.329143 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:35.329104    2572 generic.go:358] "Generic (PLEG): container finished" podID="da7813d4-c05d-4553-a08d-dca43336fc1f" containerID="c5cf329e4ffee6ec5713e4f7a9f08d42aca0dfacf5a71326f84768ae4f565bda" exitCode=0
May 28 18:52:35.329544 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:35.329196    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68" event={"ID":"da7813d4-c05d-4553-a08d-dca43336fc1f","Type":"ContainerDied","Data":"c5cf329e4ffee6ec5713e4f7a9f08d42aca0dfacf5a71326f84768ae4f565bda"}
May 28 18:52:36.465136 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:36.465105    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:36.553796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:36.553759    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkfml\" (UniqueName: \"kubernetes.io/projected/da7813d4-c05d-4553-a08d-dca43336fc1f-kube-api-access-tkfml\") pod \"da7813d4-c05d-4553-a08d-dca43336fc1f\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") "
May 28 18:52:36.553956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:36.553807    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-bundle\") pod \"da7813d4-c05d-4553-a08d-dca43336fc1f\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") "
May 28 18:52:36.553956 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:36.553866    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-util\") pod \"da7813d4-c05d-4553-a08d-dca43336fc1f\" (UID: \"da7813d4-c05d-4553-a08d-dca43336fc1f\") "
May 28 18:52:36.555075 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:36.555046    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-bundle" (OuterVolumeSpecName: "bundle") pod "da7813d4-c05d-4553-a08d-dca43336fc1f" (UID: "da7813d4-c05d-4553-a08d-dca43336fc1f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:52:36.556097 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:36.556065    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da7813d4-c05d-4553-a08d-dca43336fc1f-kube-api-access-tkfml" (OuterVolumeSpecName: "kube-api-access-tkfml") pod "da7813d4-c05d-4553-a08d-dca43336fc1f" (UID: "da7813d4-c05d-4553-a08d-dca43336fc1f"). InnerVolumeSpecName "kube-api-access-tkfml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:52:36.560174 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:36.560145    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-util" (OuterVolumeSpecName: "util") pod "da7813d4-c05d-4553-a08d-dca43336fc1f" (UID: "da7813d4-c05d-4553-a08d-dca43336fc1f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:52:36.655267 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:36.655214    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkfml\" (UniqueName: \"kubernetes.io/projected/da7813d4-c05d-4553-a08d-dca43336fc1f-kube-api-access-tkfml\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:36.655267 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:36.655235    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:36.655267 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:36.655243    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da7813d4-c05d-4553-a08d-dca43336fc1f-util\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:37.341063 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:37.341025    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68" event={"ID":"da7813d4-c05d-4553-a08d-dca43336fc1f","Type":"ContainerDied","Data":"40a2b7433298f040d9b6d0ac9d6c7cc4bbe30e86ebda7b860f5d4ce83656bde7"}
May 28 18:52:37.341063 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:37.341056    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835shw68"
May 28 18:52:37.341063 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:37.341061    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40a2b7433298f040d9b6d0ac9d6c7cc4bbe30e86ebda7b860f5d4ce83656bde7"
May 28 18:52:46.418226 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.418191    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"]
May 28 18:52:46.418700 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.418524    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da7813d4-c05d-4553-a08d-dca43336fc1f" containerName="util"
May 28 18:52:46.418700 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.418535    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da7813d4-c05d-4553-a08d-dca43336fc1f" containerName="util"
May 28 18:52:46.418700 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.418543    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da7813d4-c05d-4553-a08d-dca43336fc1f" containerName="pull"
May 28 18:52:46.418700 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.418548    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da7813d4-c05d-4553-a08d-dca43336fc1f" containerName="pull"
May 28 18:52:46.418700 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.418562    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da7813d4-c05d-4553-a08d-dca43336fc1f" containerName="extract"
May 28 18:52:46.418700 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.418569    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="da7813d4-c05d-4553-a08d-dca43336fc1f" containerName="extract"
May 28 18:52:46.418700 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.418634    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="da7813d4-c05d-4553-a08d-dca43336fc1f" containerName="extract"
May 28 18:52:46.420591 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.420576    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:46.423017 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.422995    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 18:52:46.423139 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.423078    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 18:52:46.423486 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.423472    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8q4pz\""
May 28 18:52:46.429016 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.428991    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:46.429145 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.429045    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:46.429145 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.429090    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9859l\" (UniqueName: \"kubernetes.io/projected/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-kube-api-access-9859l\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:46.429995 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.429974    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"]
May 28 18:52:46.529688 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.529650    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9859l\" (UniqueName: \"kubernetes.io/projected/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-kube-api-access-9859l\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:46.529889 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.529745    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:46.529889 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.529783    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:46.530105 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.530087    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:46.530161 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.530144    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:46.540186 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.540161    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9859l\" (UniqueName: \"kubernetes.io/projected/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-kube-api-access-9859l\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:46.730241 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.730170    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:46.870762 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:46.870740    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"]
May 28 18:52:46.872566 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:52:46.872541    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48c79e0_cb99_4a9e_adc3_5ce977f3d7be.slice/crio-8d06ee9b11656aab8a0abbcb812e19287837aa178ae57f89a057015672a655bc WatchSource:0}: Error finding container 8d06ee9b11656aab8a0abbcb812e19287837aa178ae57f89a057015672a655bc: Status 404 returned error can't find the container with id 8d06ee9b11656aab8a0abbcb812e19287837aa178ae57f89a057015672a655bc
May 28 18:52:47.375027 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:47.374989    2572 generic.go:358] "Generic (PLEG): container finished" podID="c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" containerID="a2bb93fa14c0ff5ce343a5c62617d941b8ede0895daedadda43a1cb785fc5397" exitCode=0
May 28 18:52:47.375203 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:47.375035    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9" event={"ID":"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be","Type":"ContainerDied","Data":"a2bb93fa14c0ff5ce343a5c62617d941b8ede0895daedadda43a1cb785fc5397"}
May 28 18:52:47.375203 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:47.375074    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9" event={"ID":"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be","Type":"ContainerStarted","Data":"8d06ee9b11656aab8a0abbcb812e19287837aa178ae57f89a057015672a655bc"}
May 28 18:52:48.380600 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:48.380564    2572 generic.go:358] "Generic (PLEG): container finished" podID="c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" containerID="7b252a24d133476688692240e2d8379ce4ca8dff7dd6f45f382cfc0ab5ac3637" exitCode=0
May 28 18:52:48.380600 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:48.380601    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9" event={"ID":"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be","Type":"ContainerDied","Data":"7b252a24d133476688692240e2d8379ce4ca8dff7dd6f45f382cfc0ab5ac3637"}
May 28 18:52:49.386667 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:49.386633    2572 generic.go:358] "Generic (PLEG): container finished" podID="c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" containerID="e94526db3172e6afab02fb0e3b52eaf16fb4519b6c5f3e072857f195e02afe32" exitCode=0
May 28 18:52:49.387146 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:49.386729    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9" event={"ID":"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be","Type":"ContainerDied","Data":"e94526db3172e6afab02fb0e3b52eaf16fb4519b6c5f3e072857f195e02afe32"}
May 28 18:52:50.516113 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:50.516092    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:50.556487 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:50.556459    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9859l\" (UniqueName: \"kubernetes.io/projected/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-kube-api-access-9859l\") pod \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") "
May 28 18:52:50.556604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:50.556511    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-util\") pod \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") "
May 28 18:52:50.556730 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:50.556710    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-bundle\") pod \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\" (UID: \"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be\") "
May 28 18:52:50.557548 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:50.557527    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-bundle" (OuterVolumeSpecName: "bundle") pod "c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" (UID: "c48c79e0-cb99-4a9e-adc3-5ce977f3d7be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:52:50.558526 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:50.558506    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-kube-api-access-9859l" (OuterVolumeSpecName: "kube-api-access-9859l") pod "c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" (UID: "c48c79e0-cb99-4a9e-adc3-5ce977f3d7be"). InnerVolumeSpecName "kube-api-access-9859l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:52:50.564448 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:50.564425    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-util" (OuterVolumeSpecName: "util") pod "c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" (UID: "c48c79e0-cb99-4a9e-adc3-5ce977f3d7be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:52:50.657684 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:50.657618    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-util\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:50.657684 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:50.657644    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:50.657684 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:50.657655    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9859l\" (UniqueName: \"kubernetes.io/projected/c48c79e0-cb99-4a9e-adc3-5ce977f3d7be-kube-api-access-9859l\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:52:51.395458 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:51.395426    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9" event={"ID":"c48c79e0-cb99-4a9e-adc3-5ce977f3d7be","Type":"ContainerDied","Data":"8d06ee9b11656aab8a0abbcb812e19287837aa178ae57f89a057015672a655bc"}
May 28 18:52:51.395458 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:51.395458    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d06ee9b11656aab8a0abbcb812e19287837aa178ae57f89a057015672a655bc"
May 28 18:52:51.395723 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:51.395546    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amwsw9"
May 28 18:52:59.092714 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.092670    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"]
May 28 18:52:59.093760 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.093735    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" containerName="extract"
May 28 18:52:59.093760 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.093760    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" containerName="extract"
May 28 18:52:59.093953 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.093778    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" containerName="util"
May 28 18:52:59.093953 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.093787    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" containerName="util"
May 28 18:52:59.093953 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.093797    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" containerName="pull"
May 28 18:52:59.093953 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.093806    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" containerName="pull"
May 28 18:52:59.093953 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.093880    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="c48c79e0-cb99-4a9e-adc3-5ce977f3d7be" containerName="extract"
May 28 18:52:59.103130 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.103069    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.105219 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.105193    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-97k7b\""
May 28 18:52:59.105373 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.105191    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 28 18:52:59.105838 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.105817    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"]
May 28 18:52:59.129561 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.129530    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.129731 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.129702    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb6k5\" (UniqueName: \"kubernetes.io/projected/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-kube-api-access-jb6k5\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.129841 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.129813    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.129951 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.129935    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.130017 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.129974    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.130017 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.130003    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.130117 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.130035    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.130117 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.130063    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.130117 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.130103    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231061 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231022    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231061 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231064    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231308 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231089    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231308 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231113    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231308 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231147    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231308 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231175    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231308 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231199    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jb6k5\" (UniqueName: \"kubernetes.io/projected/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-kube-api-access-jb6k5\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231308 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231252    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231695 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231349    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231695 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231545    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231695 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231608    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231846 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231773    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.231918 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.231897    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.232263 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.232240    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.233665 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.233641    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.233777 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.233690    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.249636 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.249609    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb6k5\" (UniqueName: \"kubernetes.io/projected/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-kube-api-access-jb6k5\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.250010 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.249987    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c1f8f2e1-821c-499d-a23c-f30c27d3f9c5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8s5f9g\" (UID: \"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.416516 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.416427    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:52:59.548997 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:52:59.547084    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"]
May 28 18:52:59.549594 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:52:59.549563    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f8f2e1_821c_499d_a23c_f30c27d3f9c5.slice/crio-4cdd85b86b1f64b26d8856c92d7284c44989747df13be316a4631f0873719c47 WatchSource:0}: Error finding container 4cdd85b86b1f64b26d8856c92d7284c44989747df13be316a4631f0873719c47: Status 404 returned error can't find the container with id 4cdd85b86b1f64b26d8856c92d7284c44989747df13be316a4631f0873719c47
May 28 18:53:00.430770 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:00.430737    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g" event={"ID":"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5","Type":"ContainerStarted","Data":"4cdd85b86b1f64b26d8856c92d7284c44989747df13be316a4631f0873719c47"}
May 28 18:53:01.929633 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:01.929581    2572 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:53:01.930001 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:01.929670    2572 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:53:01.930001 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:01.929715    2572 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:53:02.439841 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:02.439805    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g" event={"ID":"c1f8f2e1-821c-499d-a23c-f30c27d3f9c5","Type":"ContainerStarted","Data":"0f022bf973ee28b9645d8bdbcd20aef655ae11ea83985cebc718097e83b4bbc6"}
May 28 18:53:02.459578 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:02.459523    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g" podStartSLOduration=1.081405313 podStartE2EDuration="3.459509372s" podCreationTimestamp="2026-05-28 18:52:59 +0000 UTC" firstStartedPulling="2026-05-28 18:52:59.551209359 +0000 UTC m=+424.110984304" lastFinishedPulling="2026-05-28 18:53:01.929313413 +0000 UTC m=+426.489088363" observedRunningTime="2026-05-28 18:53:02.458504919 +0000 UTC m=+427.018279888" watchObservedRunningTime="2026-05-28 18:53:02.459509372 +0000 UTC m=+427.019284339"
May 28 18:53:03.417227 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:03.417194    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:53:03.421685 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:03.421659    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:53:03.444215 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:03.444188    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:53:03.445190 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:03.445170    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8s5f9g"
May 28 18:53:33.198965 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.198881    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dhq5z"]
May 28 18:53:33.203625 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.203604    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dhq5z"
May 28 18:53:33.205964 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.205938    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 18:53:33.206079 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.206029    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 18:53:33.206526 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.206504    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rh9mv\""
May 28 18:53:33.208437 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.208414    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dhq5z"]
May 28 18:53:33.221922 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.221893    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zts6\" (UniqueName: \"kubernetes.io/projected/cce839e8-790a-4444-aafd-fe2571938b15-kube-api-access-7zts6\") pod \"kuadrant-operator-catalog-dhq5z\" (UID: \"cce839e8-790a-4444-aafd-fe2571938b15\") " pod="kuadrant-system/kuadrant-operator-catalog-dhq5z"
May 28 18:53:33.322963 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.322929    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zts6\" (UniqueName: \"kubernetes.io/projected/cce839e8-790a-4444-aafd-fe2571938b15-kube-api-access-7zts6\") pod \"kuadrant-operator-catalog-dhq5z\" (UID: \"cce839e8-790a-4444-aafd-fe2571938b15\") " pod="kuadrant-system/kuadrant-operator-catalog-dhq5z"
May 28 18:53:33.333189 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.333159    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zts6\" (UniqueName: \"kubernetes.io/projected/cce839e8-790a-4444-aafd-fe2571938b15-kube-api-access-7zts6\") pod \"kuadrant-operator-catalog-dhq5z\" (UID: \"cce839e8-790a-4444-aafd-fe2571938b15\") " pod="kuadrant-system/kuadrant-operator-catalog-dhq5z"
May 28 18:53:33.513570 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.513541    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dhq5z"
May 28 18:53:33.573958 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.573925    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dhq5z"]
May 28 18:53:33.639335 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.639310    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dhq5z"]
May 28 18:53:33.641118 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:53:33.641093    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce839e8_790a_4444_aafd_fe2571938b15.slice/crio-b0807a9ae48cb039093886cfd7ab5e5f386e744ec0309ffbed153dea4404cf5b WatchSource:0}: Error finding container b0807a9ae48cb039093886cfd7ab5e5f386e744ec0309ffbed153dea4404cf5b: Status 404 returned error can't find the container with id b0807a9ae48cb039093886cfd7ab5e5f386e744ec0309ffbed153dea4404cf5b
May 28 18:53:33.780775 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.780694    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cj96"]
May 28 18:53:33.785365 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.785348    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8cj96"
May 28 18:53:33.789995 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.789967    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cj96"]
May 28 18:53:33.826891 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.826862    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-847bm\" (UniqueName: \"kubernetes.io/projected/b5873e08-94e6-468a-8795-0673b59f77e2-kube-api-access-847bm\") pod \"kuadrant-operator-catalog-8cj96\" (UID: \"b5873e08-94e6-468a-8795-0673b59f77e2\") " pod="kuadrant-system/kuadrant-operator-catalog-8cj96"
May 28 18:53:33.927291 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.927265    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-847bm\" (UniqueName: \"kubernetes.io/projected/b5873e08-94e6-468a-8795-0673b59f77e2-kube-api-access-847bm\") pod \"kuadrant-operator-catalog-8cj96\" (UID: \"b5873e08-94e6-468a-8795-0673b59f77e2\") " pod="kuadrant-system/kuadrant-operator-catalog-8cj96"
May 28 18:53:33.934205 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:33.934184    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-847bm\" (UniqueName: \"kubernetes.io/projected/b5873e08-94e6-468a-8795-0673b59f77e2-kube-api-access-847bm\") pod \"kuadrant-operator-catalog-8cj96\" (UID: \"b5873e08-94e6-468a-8795-0673b59f77e2\") " pod="kuadrant-system/kuadrant-operator-catalog-8cj96"
May 28 18:53:34.096093 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:34.096066    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8cj96"
May 28 18:53:34.222562 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:34.222534    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8cj96"]
May 28 18:53:34.292006 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:53:34.291977    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5873e08_94e6_468a_8795_0673b59f77e2.slice/crio-504b069e2aa03d7034ff8b5dca602150fbe804b04a5892f7dfacc80e08d77b76 WatchSource:0}: Error finding container 504b069e2aa03d7034ff8b5dca602150fbe804b04a5892f7dfacc80e08d77b76: Status 404 returned error can't find the container with id 504b069e2aa03d7034ff8b5dca602150fbe804b04a5892f7dfacc80e08d77b76
May 28 18:53:34.567937 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:34.567900    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8cj96" event={"ID":"b5873e08-94e6-468a-8795-0673b59f77e2","Type":"ContainerStarted","Data":"504b069e2aa03d7034ff8b5dca602150fbe804b04a5892f7dfacc80e08d77b76"}
May 28 18:53:34.569019 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:34.568995    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dhq5z" event={"ID":"cce839e8-790a-4444-aafd-fe2571938b15","Type":"ContainerStarted","Data":"b0807a9ae48cb039093886cfd7ab5e5f386e744ec0309ffbed153dea4404cf5b"}
May 28 18:53:36.578348 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:36.578301    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8cj96" event={"ID":"b5873e08-94e6-468a-8795-0673b59f77e2","Type":"ContainerStarted","Data":"e9b8412dbaeca19fff5aa9ab600892981f6c954ad9d02051d6813ad4f53ece5c"}
May 28 18:53:36.579837 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:36.579802    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dhq5z" event={"ID":"cce839e8-790a-4444-aafd-fe2571938b15","Type":"ContainerStarted","Data":"44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168"}
May 28 18:53:36.579958 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:36.579872    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dhq5z" podUID="cce839e8-790a-4444-aafd-fe2571938b15" containerName="registry-server" containerID="cri-o://44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168" gracePeriod=2
May 28 18:53:36.592248 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:36.592210    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8cj96" podStartSLOduration=2.025781482 podStartE2EDuration="3.592190467s" podCreationTimestamp="2026-05-28 18:53:33 +0000 UTC" firstStartedPulling="2026-05-28 18:53:34.293343402 +0000 UTC m=+458.853118348" lastFinishedPulling="2026-05-28 18:53:35.859752388 +0000 UTC m=+460.419527333" observedRunningTime="2026-05-28 18:53:36.590456898 +0000 UTC m=+461.150231867" watchObservedRunningTime="2026-05-28 18:53:36.592190467 +0000 UTC m=+461.151965435"
May 28 18:53:36.603611 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:36.603572    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dhq5z" podStartSLOduration=1.3889572079999999 podStartE2EDuration="3.603559912s" podCreationTimestamp="2026-05-28 18:53:33 +0000 UTC" firstStartedPulling="2026-05-28 18:53:33.642344917 +0000 UTC m=+458.202119862" lastFinishedPulling="2026-05-28 18:53:35.856947605 +0000 UTC m=+460.416722566" observedRunningTime="2026-05-28 18:53:36.603143169 +0000 UTC m=+461.162918137" watchObservedRunningTime="2026-05-28 18:53:36.603559912 +0000 UTC m=+461.163334880"
May 28 18:53:36.819268 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:36.819243    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dhq5z"
May 28 18:53:36.860526 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:36.860455    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zts6\" (UniqueName: \"kubernetes.io/projected/cce839e8-790a-4444-aafd-fe2571938b15-kube-api-access-7zts6\") pod \"cce839e8-790a-4444-aafd-fe2571938b15\" (UID: \"cce839e8-790a-4444-aafd-fe2571938b15\") "
May 28 18:53:36.862728 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:36.862700    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cce839e8-790a-4444-aafd-fe2571938b15-kube-api-access-7zts6" (OuterVolumeSpecName: "kube-api-access-7zts6") pod "cce839e8-790a-4444-aafd-fe2571938b15" (UID: "cce839e8-790a-4444-aafd-fe2571938b15"). InnerVolumeSpecName "kube-api-access-7zts6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:53:36.962116 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:36.962088    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zts6\" (UniqueName: \"kubernetes.io/projected/cce839e8-790a-4444-aafd-fe2571938b15-kube-api-access-7zts6\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:37.584923 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:37.584884    2572 generic.go:358] "Generic (PLEG): container finished" podID="cce839e8-790a-4444-aafd-fe2571938b15" containerID="44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168" exitCode=0
May 28 18:53:37.585354 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:37.584969    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dhq5z" event={"ID":"cce839e8-790a-4444-aafd-fe2571938b15","Type":"ContainerDied","Data":"44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168"}
May 28 18:53:37.585354 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:37.584988    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dhq5z"
May 28 18:53:37.585354 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:37.585006    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dhq5z" event={"ID":"cce839e8-790a-4444-aafd-fe2571938b15","Type":"ContainerDied","Data":"b0807a9ae48cb039093886cfd7ab5e5f386e744ec0309ffbed153dea4404cf5b"}
May 28 18:53:37.585354 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:37.585022    2572 scope.go:117] "RemoveContainer" containerID="44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168"
May 28 18:53:37.593708 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:37.593691    2572 scope.go:117] "RemoveContainer" containerID="44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168"
May 28 18:53:37.593927 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:53:37.593909    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168\": container with ID starting with 44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168 not found: ID does not exist" containerID="44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168"
May 28 18:53:37.593971 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:37.593935    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168"} err="failed to get container status \"44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168\": rpc error: code = NotFound desc = could not find container \"44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168\": container with ID starting with 44fd7f5893d9e04a890b918ffb5d6f5da1b1ab5a2395d21caff9c29e0515c168 not found: ID does not exist"
May 28 18:53:37.604146 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:37.604111    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dhq5z"]
May 28 18:53:37.606257 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:37.606239    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dhq5z"]
May 28 18:53:38.061380 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:38.061345    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cce839e8-790a-4444-aafd-fe2571938b15" path="/var/lib/kubelet/pods/cce839e8-790a-4444-aafd-fe2571938b15/volumes"
May 28 18:53:44.097110 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:44.097070    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8cj96"
May 28 18:53:44.097110 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:44.097120    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8cj96"
May 28 18:53:44.118580 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:44.118552    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8cj96"
May 28 18:53:44.631675 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:44.631648    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8cj96"
May 28 18:53:48.416731 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.416697    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"]
May 28 18:53:48.417173 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.417154    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cce839e8-790a-4444-aafd-fe2571938b15" containerName="registry-server"
May 28 18:53:48.417217 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.417175    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cce839e8-790a-4444-aafd-fe2571938b15" containerName="registry-server"
May 28 18:53:48.417251 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.417244    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="cce839e8-790a-4444-aafd-fe2571938b15" containerName="registry-server"
May 28 18:53:48.420356 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.420341    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:48.422487 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.422472    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hnfz8\""
May 28 18:53:48.427162 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.427137    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"]
May 28 18:53:48.459562 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.459535    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f4hx\" (UniqueName: \"kubernetes.io/projected/391a33c2-be3c-4de8-ac28-4364fb41b00c-kube-api-access-4f4hx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:48.459686 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.459601    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:48.459686 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.459653    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:48.560868 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.560835    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4f4hx\" (UniqueName: \"kubernetes.io/projected/391a33c2-be3c-4de8-ac28-4364fb41b00c-kube-api-access-4f4hx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:48.561004 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.560889    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:48.561004 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.560919    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:48.561340 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.561319    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:48.561374 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.561330    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:48.568682 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.568654    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f4hx\" (UniqueName: \"kubernetes.io/projected/391a33c2-be3c-4de8-ac28-4364fb41b00c-kube-api-access-4f4hx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:48.730855 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.730774    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:48.856859 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:48.856833    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"]
May 28 18:53:48.858238 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:53:48.858211    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod391a33c2_be3c_4de8_ac28_4364fb41b00c.slice/crio-ababf7b7758877a55ded1cda75a22357ac52642d51845956c9a9369e68c453b6 WatchSource:0}: Error finding container ababf7b7758877a55ded1cda75a22357ac52642d51845956c9a9369e68c453b6: Status 404 returned error can't find the container with id ababf7b7758877a55ded1cda75a22357ac52642d51845956c9a9369e68c453b6
May 28 18:53:49.212545 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.212513    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"]
May 28 18:53:49.216082 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.216066    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:49.223208 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.223183    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"]
May 28 18:53:49.266568 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.266534    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:49.266741 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.266598    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:49.266741 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.266638    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6plm\" (UniqueName: \"kubernetes.io/projected/6639d934-9039-4af0-a186-7a601ff03fde-kube-api-access-t6plm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:49.367677 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.367619    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:49.367886 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.367720    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:49.367886 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.367763    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6plm\" (UniqueName: \"kubernetes.io/projected/6639d934-9039-4af0-a186-7a601ff03fde-kube-api-access-t6plm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:49.368113 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.368088    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:49.368170 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.368110    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:49.375352 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.375320    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6plm\" (UniqueName: \"kubernetes.io/projected/6639d934-9039-4af0-a186-7a601ff03fde-kube-api-access-t6plm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:49.526802 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.526709    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:49.629683 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.629648    2572 generic.go:358] "Generic (PLEG): container finished" podID="391a33c2-be3c-4de8-ac28-4364fb41b00c" containerID="6ac5ddf7464a40bf7e7c20c021326ef267f5aea603d42be5102ae4cf57199d7a" exitCode=0
May 28 18:53:49.629846 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.629700    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92" event={"ID":"391a33c2-be3c-4de8-ac28-4364fb41b00c","Type":"ContainerDied","Data":"6ac5ddf7464a40bf7e7c20c021326ef267f5aea603d42be5102ae4cf57199d7a"}
May 28 18:53:49.629846 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.629737    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92" event={"ID":"391a33c2-be3c-4de8-ac28-4364fb41b00c","Type":"ContainerStarted","Data":"ababf7b7758877a55ded1cda75a22357ac52642d51845956c9a9369e68c453b6"}
May 28 18:53:49.653716 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.653694    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"]
May 28 18:53:49.655686 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:53:49.655660    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6639d934_9039_4af0_a186_7a601ff03fde.slice/crio-b608792b54fbe00fac8b115f7985ae921629ce4b8f0aedeee0bf3c7d65d9e113 WatchSource:0}: Error finding container b608792b54fbe00fac8b115f7985ae921629ce4b8f0aedeee0bf3c7d65d9e113: Status 404 returned error can't find the container with id b608792b54fbe00fac8b115f7985ae921629ce4b8f0aedeee0bf3c7d65d9e113
May 28 18:53:49.811707 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.811679    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"]
May 28 18:53:49.815285 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.815268    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:49.821453 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.821429    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"]
May 28 18:53:49.872814 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.872779    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd6vp\" (UniqueName: \"kubernetes.io/projected/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-kube-api-access-gd6vp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:49.872989 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.872844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:49.872989 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.872862    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:49.974345 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.974308    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gd6vp\" (UniqueName: \"kubernetes.io/projected/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-kube-api-access-gd6vp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:49.974527 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.974372    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:49.974527 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.974420    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:49.974739 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.974719    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:49.974780 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.974745    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:49.981861 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:49.981840    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd6vp\" (UniqueName: \"kubernetes.io/projected/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-kube-api-access-gd6vp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:50.125332 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.125268    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:50.256167 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.256142    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"]
May 28 18:53:50.346325 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:53:50.346293    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a1ef9c_5277_45c7_a3d3_3aa56a1171fb.slice/crio-6edd7b87cbb7aaec3df6aec6b7525ba647506bab37cd4126decc7b7e993ccc0d WatchSource:0}: Error finding container 6edd7b87cbb7aaec3df6aec6b7525ba647506bab37cd4126decc7b7e993ccc0d: Status 404 returned error can't find the container with id 6edd7b87cbb7aaec3df6aec6b7525ba647506bab37cd4126decc7b7e993ccc0d
May 28 18:53:50.416874 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.416835    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"]
May 28 18:53:50.420693 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.420667    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:50.426586 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.426562    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"]
May 28 18:53:50.479611 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.479584    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbkfp\" (UniqueName: \"kubernetes.io/projected/ef0725b1-977f-412a-a920-ee8f9d81519f-kube-api-access-sbkfp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:50.479740 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.479676    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:50.479813 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.479739    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:50.580663 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.580631    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:50.581041 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.580697    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:50.581041 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.580749    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbkfp\" (UniqueName: \"kubernetes.io/projected/ef0725b1-977f-412a-a920-ee8f9d81519f-kube-api-access-sbkfp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:50.581041 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.581031    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:50.581154 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.581058    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:50.589447 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.589421    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbkfp\" (UniqueName: \"kubernetes.io/projected/ef0725b1-977f-412a-a920-ee8f9d81519f-kube-api-access-sbkfp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:50.636280 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.636192    2572 generic.go:358] "Generic (PLEG): container finished" podID="95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" containerID="abe6a6be65e70108eb118a62b2c1144f9651592553de93b5016aa2e2009a1f6f" exitCode=0
May 28 18:53:50.636445 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.636286    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm" event={"ID":"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb","Type":"ContainerDied","Data":"abe6a6be65e70108eb118a62b2c1144f9651592553de93b5016aa2e2009a1f6f"}
May 28 18:53:50.636445 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.636328    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm" event={"ID":"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb","Type":"ContainerStarted","Data":"6edd7b87cbb7aaec3df6aec6b7525ba647506bab37cd4126decc7b7e993ccc0d"}
May 28 18:53:50.637753 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.637728    2572 generic.go:358] "Generic (PLEG): container finished" podID="6639d934-9039-4af0-a186-7a601ff03fde" containerID="ecd02207a086cd99ba3ad1247520ea57b11985263ac71dd3d5c7b631b3fdfbd7" exitCode=0
May 28 18:53:50.637866 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.637801    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh" event={"ID":"6639d934-9039-4af0-a186-7a601ff03fde","Type":"ContainerDied","Data":"ecd02207a086cd99ba3ad1247520ea57b11985263ac71dd3d5c7b631b3fdfbd7"}
May 28 18:53:50.637866 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.637826    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh" event={"ID":"6639d934-9039-4af0-a186-7a601ff03fde","Type":"ContainerStarted","Data":"b608792b54fbe00fac8b115f7985ae921629ce4b8f0aedeee0bf3c7d65d9e113"}
May 28 18:53:50.639570 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.639546    2572 generic.go:358] "Generic (PLEG): container finished" podID="391a33c2-be3c-4de8-ac28-4364fb41b00c" containerID="4ea2d417ff0e49027db66b496fe77dd5910a34029942d1daf0048a271a6b1656" exitCode=0
May 28 18:53:50.639734 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.639577    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92" event={"ID":"391a33c2-be3c-4de8-ac28-4364fb41b00c","Type":"ContainerDied","Data":"4ea2d417ff0e49027db66b496fe77dd5910a34029942d1daf0048a271a6b1656"}
May 28 18:53:50.782061 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.782030    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:50.909185 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:50.909152    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"]
May 28 18:53:50.910616 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:53:50.910594    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0725b1_977f_412a_a920_ee8f9d81519f.slice/crio-a9c8d88f1b2d2873fced4a83c8145009cb78c1aea16d1adbfdf25a2c60407dca WatchSource:0}: Error finding container a9c8d88f1b2d2873fced4a83c8145009cb78c1aea16d1adbfdf25a2c60407dca: Status 404 returned error can't find the container with id a9c8d88f1b2d2873fced4a83c8145009cb78c1aea16d1adbfdf25a2c60407dca
May 28 18:53:51.645549 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:51.645512    2572 generic.go:358] "Generic (PLEG): container finished" podID="391a33c2-be3c-4de8-ac28-4364fb41b00c" containerID="7dc32a7826d4881b286c8460c405cff585d2c4558e01c6ddd245ba22e4fd1432" exitCode=0
May 28 18:53:51.645922 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:51.645587    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92" event={"ID":"391a33c2-be3c-4de8-ac28-4364fb41b00c","Type":"ContainerDied","Data":"7dc32a7826d4881b286c8460c405cff585d2c4558e01c6ddd245ba22e4fd1432"}
May 28 18:53:51.647109 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:51.647085    2572 generic.go:358] "Generic (PLEG): container finished" podID="95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" containerID="e558dc15aaa643c71d2996af171d5cdb23efcd92d00047faf1d21464d10bfc94" exitCode=0
May 28 18:53:51.647180 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:51.647162    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm" event={"ID":"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb","Type":"ContainerDied","Data":"e558dc15aaa643c71d2996af171d5cdb23efcd92d00047faf1d21464d10bfc94"}
May 28 18:53:51.648569 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:51.648551    2572 generic.go:358] "Generic (PLEG): container finished" podID="ef0725b1-977f-412a-a920-ee8f9d81519f" containerID="5a9b8179bc8ff3f801daee0cebf90b4ec6e9f84f67628d810fec73cf7f753d71" exitCode=0
May 28 18:53:51.648671 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:51.648641    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj" event={"ID":"ef0725b1-977f-412a-a920-ee8f9d81519f","Type":"ContainerDied","Data":"5a9b8179bc8ff3f801daee0cebf90b4ec6e9f84f67628d810fec73cf7f753d71"}
May 28 18:53:51.648671 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:51.648670    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj" event={"ID":"ef0725b1-977f-412a-a920-ee8f9d81519f","Type":"ContainerStarted","Data":"a9c8d88f1b2d2873fced4a83c8145009cb78c1aea16d1adbfdf25a2c60407dca"}
May 28 18:53:51.650365 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:51.650342    2572 generic.go:358] "Generic (PLEG): container finished" podID="6639d934-9039-4af0-a186-7a601ff03fde" containerID="5d1649672caec617c637542ebfd2c1dbcb1dd4d7a82f8d0691f506974bf9613c" exitCode=0
May 28 18:53:51.650482 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:51.650410    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh" event={"ID":"6639d934-9039-4af0-a186-7a601ff03fde","Type":"ContainerDied","Data":"5d1649672caec617c637542ebfd2c1dbcb1dd4d7a82f8d0691f506974bf9613c"}
May 28 18:53:52.657321 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.657285    2572 generic.go:358] "Generic (PLEG): container finished" podID="6639d934-9039-4af0-a186-7a601ff03fde" containerID="71feb19222c1734f5ab5056d8f507d53cc4a4c649c2b84d748b8d09e79905795" exitCode=0
May 28 18:53:52.657742 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.657368    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh" event={"ID":"6639d934-9039-4af0-a186-7a601ff03fde","Type":"ContainerDied","Data":"71feb19222c1734f5ab5056d8f507d53cc4a4c649c2b84d748b8d09e79905795"}
May 28 18:53:52.659101 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.659078    2572 generic.go:358] "Generic (PLEG): container finished" podID="95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" containerID="62359942788e683da529b551791d3bf9ebde23899db156afbfbf539d3a09bb10" exitCode=0
May 28 18:53:52.659231 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.659192    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm" event={"ID":"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb","Type":"ContainerDied","Data":"62359942788e683da529b551791d3bf9ebde23899db156afbfbf539d3a09bb10"}
May 28 18:53:52.660575 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.660550    2572 generic.go:358] "Generic (PLEG): container finished" podID="ef0725b1-977f-412a-a920-ee8f9d81519f" containerID="205b53cb01e533734cb31cb9ac3edd07e20b2f1d772927b5e0ed60ba9cd47570" exitCode=0
May 28 18:53:52.660710 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.660654    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj" event={"ID":"ef0725b1-977f-412a-a920-ee8f9d81519f","Type":"ContainerDied","Data":"205b53cb01e533734cb31cb9ac3edd07e20b2f1d772927b5e0ed60ba9cd47570"}
May 28 18:53:52.854282 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.854219    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:52.901701 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.901675    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-bundle\") pod \"391a33c2-be3c-4de8-ac28-4364fb41b00c\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") "
May 28 18:53:52.901854 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.901727    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f4hx\" (UniqueName: \"kubernetes.io/projected/391a33c2-be3c-4de8-ac28-4364fb41b00c-kube-api-access-4f4hx\") pod \"391a33c2-be3c-4de8-ac28-4364fb41b00c\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") "
May 28 18:53:52.901854 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.901774    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-util\") pod \"391a33c2-be3c-4de8-ac28-4364fb41b00c\" (UID: \"391a33c2-be3c-4de8-ac28-4364fb41b00c\") "
May 28 18:53:52.902218 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.902193    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-bundle" (OuterVolumeSpecName: "bundle") pod "391a33c2-be3c-4de8-ac28-4364fb41b00c" (UID: "391a33c2-be3c-4de8-ac28-4364fb41b00c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:53:52.903789 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.903767    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/391a33c2-be3c-4de8-ac28-4364fb41b00c-kube-api-access-4f4hx" (OuterVolumeSpecName: "kube-api-access-4f4hx") pod "391a33c2-be3c-4de8-ac28-4364fb41b00c" (UID: "391a33c2-be3c-4de8-ac28-4364fb41b00c"). InnerVolumeSpecName "kube-api-access-4f4hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:53:52.906629 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:52.906609    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-util" (OuterVolumeSpecName: "util") pod "391a33c2-be3c-4de8-ac28-4364fb41b00c" (UID: "391a33c2-be3c-4de8-ac28-4364fb41b00c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:53:53.002503 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.002464    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f4hx\" (UniqueName: \"kubernetes.io/projected/391a33c2-be3c-4de8-ac28-4364fb41b00c-kube-api-access-4f4hx\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:53.002503 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.002501    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-util\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:53.002503 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.002512    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391a33c2-be3c-4de8-ac28-4364fb41b00c-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:53.671879 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.671837    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92" event={"ID":"391a33c2-be3c-4de8-ac28-4364fb41b00c","Type":"ContainerDied","Data":"ababf7b7758877a55ded1cda75a22357ac52642d51845956c9a9369e68c453b6"}
May 28 18:53:53.671879 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.671865    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92"
May 28 18:53:53.671879 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.671880    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ababf7b7758877a55ded1cda75a22357ac52642d51845956c9a9369e68c453b6"
May 28 18:53:53.673879 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.673854    2572 generic.go:358] "Generic (PLEG): container finished" podID="ef0725b1-977f-412a-a920-ee8f9d81519f" containerID="de5c2a97163b69e52c43e96efd9a8a727a06a6bd22dea9df681cc69dd956d75b" exitCode=0
May 28 18:53:53.674007 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.673940    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj" event={"ID":"ef0725b1-977f-412a-a920-ee8f9d81519f","Type":"ContainerDied","Data":"de5c2a97163b69e52c43e96efd9a8a727a06a6bd22dea9df681cc69dd956d75b"}
May 28 18:53:53.810185 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.810165    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:53.840834 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.840815    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:53.911696 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.911667    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-util\") pod \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") "
May 28 18:53:53.911830 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.911720    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-bundle\") pod \"6639d934-9039-4af0-a186-7a601ff03fde\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") "
May 28 18:53:53.911830 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.911747    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd6vp\" (UniqueName: \"kubernetes.io/projected/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-kube-api-access-gd6vp\") pod \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") "
May 28 18:53:53.911830 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.911763    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-util\") pod \"6639d934-9039-4af0-a186-7a601ff03fde\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") "
May 28 18:53:53.911830 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.911782    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-bundle\") pod \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\" (UID: \"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb\") "
May 28 18:53:53.912017 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.911831    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6plm\" (UniqueName: \"kubernetes.io/projected/6639d934-9039-4af0-a186-7a601ff03fde-kube-api-access-t6plm\") pod \"6639d934-9039-4af0-a186-7a601ff03fde\" (UID: \"6639d934-9039-4af0-a186-7a601ff03fde\") "
May 28 18:53:53.912428 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.912371    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-bundle" (OuterVolumeSpecName: "bundle") pod "6639d934-9039-4af0-a186-7a601ff03fde" (UID: "6639d934-9039-4af0-a186-7a601ff03fde"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:53:53.912543 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.912517    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-bundle" (OuterVolumeSpecName: "bundle") pod "95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" (UID: "95a1ef9c-5277-45c7-a3d3-3aa56a1171fb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:53:53.914048 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.914022    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6639d934-9039-4af0-a186-7a601ff03fde-kube-api-access-t6plm" (OuterVolumeSpecName: "kube-api-access-t6plm") pod "6639d934-9039-4af0-a186-7a601ff03fde" (UID: "6639d934-9039-4af0-a186-7a601ff03fde"). InnerVolumeSpecName "kube-api-access-t6plm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:53:53.914143 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.914054    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-kube-api-access-gd6vp" (OuterVolumeSpecName: "kube-api-access-gd6vp") pod "95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" (UID: "95a1ef9c-5277-45c7-a3d3-3aa56a1171fb"). InnerVolumeSpecName "kube-api-access-gd6vp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:53:53.916746 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.916725    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-util" (OuterVolumeSpecName: "util") pod "6639d934-9039-4af0-a186-7a601ff03fde" (UID: "6639d934-9039-4af0-a186-7a601ff03fde"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:53:53.917688 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:53.917670    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-util" (OuterVolumeSpecName: "util") pod "95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" (UID: "95a1ef9c-5277-45c7-a3d3-3aa56a1171fb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:53:54.012607 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.012579    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-util\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:54.012607 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.012605    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:54.012781 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.012615    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd6vp\" (UniqueName: \"kubernetes.io/projected/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-kube-api-access-gd6vp\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:54.012781 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.012626    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6639d934-9039-4af0-a186-7a601ff03fde-util\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:54.012781 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.012634    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95a1ef9c-5277-45c7-a3d3-3aa56a1171fb-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:54.012781 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.012642    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6plm\" (UniqueName: \"kubernetes.io/projected/6639d934-9039-4af0-a186-7a601ff03fde-kube-api-access-t6plm\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:54.680857 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.680820    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh" event={"ID":"6639d934-9039-4af0-a186-7a601ff03fde","Type":"ContainerDied","Data":"b608792b54fbe00fac8b115f7985ae921629ce4b8f0aedeee0bf3c7d65d9e113"}
May 28 18:53:54.680857 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.680860    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b608792b54fbe00fac8b115f7985ae921629ce4b8f0aedeee0bf3c7d65d9e113"
May 28 18:53:54.681360 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.680833    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh"
May 28 18:53:54.682652 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.682625    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm" event={"ID":"95a1ef9c-5277-45c7-a3d3-3aa56a1171fb","Type":"ContainerDied","Data":"6edd7b87cbb7aaec3df6aec6b7525ba647506bab37cd4126decc7b7e993ccc0d"}
May 28 18:53:54.682652 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.682652    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6edd7b87cbb7aaec3df6aec6b7525ba647506bab37cd4126decc7b7e993ccc0d"
May 28 18:53:54.682840 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.682658    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm"
May 28 18:53:54.810999 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.810975    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:54.920866 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.920797    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-bundle\") pod \"ef0725b1-977f-412a-a920-ee8f9d81519f\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") "
May 28 18:53:54.920866 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.920830    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-util\") pod \"ef0725b1-977f-412a-a920-ee8f9d81519f\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") "
May 28 18:53:54.921070 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.920891    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbkfp\" (UniqueName: \"kubernetes.io/projected/ef0725b1-977f-412a-a920-ee8f9d81519f-kube-api-access-sbkfp\") pod \"ef0725b1-977f-412a-a920-ee8f9d81519f\" (UID: \"ef0725b1-977f-412a-a920-ee8f9d81519f\") "
May 28 18:53:54.921321 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.921286    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-bundle" (OuterVolumeSpecName: "bundle") pod "ef0725b1-977f-412a-a920-ee8f9d81519f" (UID: "ef0725b1-977f-412a-a920-ee8f9d81519f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:53:54.922918 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.922897    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef0725b1-977f-412a-a920-ee8f9d81519f-kube-api-access-sbkfp" (OuterVolumeSpecName: "kube-api-access-sbkfp") pod "ef0725b1-977f-412a-a920-ee8f9d81519f" (UID: "ef0725b1-977f-412a-a920-ee8f9d81519f"). InnerVolumeSpecName "kube-api-access-sbkfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:53:54.926099 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:54.926077    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-util" (OuterVolumeSpecName: "util") pod "ef0725b1-977f-412a-a920-ee8f9d81519f" (UID: "ef0725b1-977f-412a-a920-ee8f9d81519f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:53:55.022344 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:55.022309    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbkfp\" (UniqueName: \"kubernetes.io/projected/ef0725b1-977f-412a-a920-ee8f9d81519f-kube-api-access-sbkfp\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:55.022344 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:55.022338    2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:55.022344 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:55.022347    2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef0725b1-977f-412a-a920-ee8f9d81519f-util\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:53:55.688979 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:55.688952    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj"
May 28 18:53:55.689360 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:55.688948    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj" event={"ID":"ef0725b1-977f-412a-a920-ee8f9d81519f","Type":"ContainerDied","Data":"a9c8d88f1b2d2873fced4a83c8145009cb78c1aea16d1adbfdf25a2c60407dca"}
May 28 18:53:55.689360 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:53:55.689053    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9c8d88f1b2d2873fced4a83c8145009cb78c1aea16d1adbfdf25a2c60407dca"
May 28 18:54:02.061006 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.060979    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-59566b6447-mcjj6"]
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061286    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" containerName="util"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061299    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" containerName="util"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061308    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef0725b1-977f-412a-a920-ee8f9d81519f" containerName="util"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061314    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef0725b1-977f-412a-a920-ee8f9d81519f" containerName="util"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061325    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" containerName="pull"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061330    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" containerName="pull"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061338    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6639d934-9039-4af0-a186-7a601ff03fde" containerName="util"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061342    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6639d934-9039-4af0-a186-7a601ff03fde" containerName="util"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061348    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6639d934-9039-4af0-a186-7a601ff03fde" containerName="pull"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061353    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6639d934-9039-4af0-a186-7a601ff03fde" containerName="pull"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061359    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391a33c2-be3c-4de8-ac28-4364fb41b00c" containerName="extract"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061363    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="391a33c2-be3c-4de8-ac28-4364fb41b00c" containerName="extract"
May 28 18:54:02.061366 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061372    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" containerName="extract"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061377    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" containerName="extract"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061404    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6639d934-9039-4af0-a186-7a601ff03fde" containerName="extract"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061409    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6639d934-9039-4af0-a186-7a601ff03fde" containerName="extract"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061416    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef0725b1-977f-412a-a920-ee8f9d81519f" containerName="extract"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061422    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef0725b1-977f-412a-a920-ee8f9d81519f" containerName="extract"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061429    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391a33c2-be3c-4de8-ac28-4364fb41b00c" containerName="pull"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061434    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="391a33c2-be3c-4de8-ac28-4364fb41b00c" containerName="pull"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061444    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391a33c2-be3c-4de8-ac28-4364fb41b00c" containerName="util"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061448    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="391a33c2-be3c-4de8-ac28-4364fb41b00c" containerName="util"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061453    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef0725b1-977f-412a-a920-ee8f9d81519f" containerName="pull"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061457    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef0725b1-977f-412a-a920-ee8f9d81519f" containerName="pull"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061504    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="391a33c2-be3c-4de8-ac28-4364fb41b00c" containerName="extract"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061515    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="6639d934-9039-4af0-a186-7a601ff03fde" containerName="extract"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061523    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="95a1ef9c-5277-45c7-a3d3-3aa56a1171fb" containerName="extract"
May 28 18:54:02.061755 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.061529    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef0725b1-977f-412a-a920-ee8f9d81519f" containerName="extract"
May 28 18:54:02.066298 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.066272    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.069423 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.069379    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59566b6447-mcjj6"]
May 28 18:54:02.182503 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.182474    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3420429-889b-4096-abd4-551130eba093-console-oauth-config\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.182503 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.182505    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-trusted-ca-bundle\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.182731 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.182539    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-service-ca\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.182731 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.182599    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-oauth-serving-cert\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.182731 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.182667    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3420429-889b-4096-abd4-551130eba093-console-serving-cert\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.182731 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.182687    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-console-config\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.182731 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.182721    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h4bh\" (UniqueName: \"kubernetes.io/projected/b3420429-889b-4096-abd4-551130eba093-kube-api-access-6h4bh\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.284079 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.284040    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6h4bh\" (UniqueName: \"kubernetes.io/projected/b3420429-889b-4096-abd4-551130eba093-kube-api-access-6h4bh\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.284252 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.284152    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3420429-889b-4096-abd4-551130eba093-console-oauth-config\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.284252 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.284178    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-trusted-ca-bundle\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.284252 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.284213    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-service-ca\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.284252 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.284239    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-oauth-serving-cert\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.284495 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.284302    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3420429-889b-4096-abd4-551130eba093-console-serving-cert\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.284495 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.284326    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-console-config\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.285233 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.285195    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-console-config\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.285738 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.285715    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-service-ca\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.286702 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.286422    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-trusted-ca-bundle\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.286826 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.286772    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3420429-889b-4096-abd4-551130eba093-oauth-serving-cert\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.287511 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.287469    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3420429-889b-4096-abd4-551130eba093-console-serving-cert\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.287975 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.287948    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3420429-889b-4096-abd4-551130eba093-console-oauth-config\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.292507 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.292465    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h4bh\" (UniqueName: \"kubernetes.io/projected/b3420429-889b-4096-abd4-551130eba093-kube-api-access-6h4bh\") pod \"console-59566b6447-mcjj6\" (UID: \"b3420429-889b-4096-abd4-551130eba093\") " pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.380549 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.380460    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:02.512756 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.512730    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59566b6447-mcjj6"]
May 28 18:54:02.514254 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:54:02.514230    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3420429_889b_4096_abd4_551130eba093.slice/crio-a1c6022fb785247c81d0987c37dfde20b8adb01471693daf09328f63910ddf7f WatchSource:0}: Error finding container a1c6022fb785247c81d0987c37dfde20b8adb01471693daf09328f63910ddf7f: Status 404 returned error can't find the container with id a1c6022fb785247c81d0987c37dfde20b8adb01471693daf09328f63910ddf7f
May 28 18:54:02.716362 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.716274    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59566b6447-mcjj6" event={"ID":"b3420429-889b-4096-abd4-551130eba093","Type":"ContainerStarted","Data":"93c414722873ce9ef8e887cc8ceeb52ad99e7cee03194293158a15f6f67e85fe"}
May 28 18:54:02.716362 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.716317    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59566b6447-mcjj6" event={"ID":"b3420429-889b-4096-abd4-551130eba093","Type":"ContainerStarted","Data":"a1c6022fb785247c81d0987c37dfde20b8adb01471693daf09328f63910ddf7f"}
May 28 18:54:02.734326 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:02.734281    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-59566b6447-mcjj6" podStartSLOduration=0.73426448 podStartE2EDuration="734.26448ms" podCreationTimestamp="2026-05-28 18:54:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:54:02.733330448 +0000 UTC m=+487.293105426" watchObservedRunningTime="2026-05-28 18:54:02.73426448 +0000 UTC m=+487.294039450"
May 28 18:54:11.359050 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:11.359016    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"]
May 28 18:54:11.367821 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:11.367800    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"
May 28 18:54:11.369220 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:11.369195    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"]
May 28 18:54:11.369917 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:11.369898    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-f2h6z\""
May 28 18:54:11.466936 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:11.466898    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnc49\" (UniqueName: \"kubernetes.io/projected/333dbfae-b376-4673-8fb9-f5a3becc7cdc-kube-api-access-rnc49\") pod \"limitador-operator-controller-manager-85c4996f8c-s8d82\" (UID: \"333dbfae-b376-4673-8fb9-f5a3becc7cdc\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"
May 28 18:54:11.567625 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:11.567588    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnc49\" (UniqueName: \"kubernetes.io/projected/333dbfae-b376-4673-8fb9-f5a3becc7cdc-kube-api-access-rnc49\") pod \"limitador-operator-controller-manager-85c4996f8c-s8d82\" (UID: \"333dbfae-b376-4673-8fb9-f5a3becc7cdc\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"
May 28 18:54:11.578146 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:11.578118    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnc49\" (UniqueName: \"kubernetes.io/projected/333dbfae-b376-4673-8fb9-f5a3becc7cdc-kube-api-access-rnc49\") pod \"limitador-operator-controller-manager-85c4996f8c-s8d82\" (UID: \"333dbfae-b376-4673-8fb9-f5a3becc7cdc\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"
May 28 18:54:11.678719 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:11.678635    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"
May 28 18:54:11.811762 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:11.811737    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"]
May 28 18:54:11.813825 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:54:11.813797    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333dbfae_b376_4673_8fb9_f5a3becc7cdc.slice/crio-6151bb196d686f13b960457ba8707b4ebce91d4b0c9f64636699c75f0e652e50 WatchSource:0}: Error finding container 6151bb196d686f13b960457ba8707b4ebce91d4b0c9f64636699c75f0e652e50: Status 404 returned error can't find the container with id 6151bb196d686f13b960457ba8707b4ebce91d4b0c9f64636699c75f0e652e50
May 28 18:54:12.381629 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:12.381596    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:12.381629 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:12.381637    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:12.387213 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:12.387190    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:12.756918 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:12.756824    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82" event={"ID":"333dbfae-b376-4673-8fb9-f5a3becc7cdc","Type":"ContainerStarted","Data":"6151bb196d686f13b960457ba8707b4ebce91d4b0c9f64636699c75f0e652e50"}
May 28 18:54:12.761337 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:12.761310    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59566b6447-mcjj6"
May 28 18:54:12.819662 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:12.819627    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6569b5f748-frlcn"]
May 28 18:54:14.766207 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:14.766173    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82" event={"ID":"333dbfae-b376-4673-8fb9-f5a3becc7cdc","Type":"ContainerStarted","Data":"46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97"}
May 28 18:54:14.766642 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:14.766250    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"
May 28 18:54:14.788304 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:14.788250    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82" podStartSLOduration=1.801510177 podStartE2EDuration="3.788237948s" podCreationTimestamp="2026-05-28 18:54:11 +0000 UTC" firstStartedPulling="2026-05-28 18:54:11.815623309 +0000 UTC m=+496.375398254" lastFinishedPulling="2026-05-28 18:54:13.802351077 +0000 UTC m=+498.362126025" observedRunningTime="2026-05-28 18:54:14.787441397 +0000 UTC m=+499.347216365" watchObservedRunningTime="2026-05-28 18:54:14.788237948 +0000 UTC m=+499.348012916"
May 28 18:54:18.050752 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:18.050714    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-d7t2n"]
May 28 18:54:18.055612 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:18.055588    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-d7t2n"
May 28 18:54:18.057908 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:18.057870    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-m6nkg\""
May 28 18:54:18.064402 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:18.064358    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-d7t2n"]
May 28 18:54:18.231513 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:18.231473    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6cdt\" (UniqueName: \"kubernetes.io/projected/5c6abec5-880a-4d69-bddd-d8e7cfa0e9fa-kube-api-access-n6cdt\") pod \"authorino-operator-657f44b778-d7t2n\" (UID: \"5c6abec5-880a-4d69-bddd-d8e7cfa0e9fa\") " pod="kuadrant-system/authorino-operator-657f44b778-d7t2n"
May 28 18:54:18.332378 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:18.332344    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6cdt\" (UniqueName: \"kubernetes.io/projected/5c6abec5-880a-4d69-bddd-d8e7cfa0e9fa-kube-api-access-n6cdt\") pod \"authorino-operator-657f44b778-d7t2n\" (UID: \"5c6abec5-880a-4d69-bddd-d8e7cfa0e9fa\") " pod="kuadrant-system/authorino-operator-657f44b778-d7t2n"
May 28 18:54:18.340102 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:18.340080    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6cdt\" (UniqueName: \"kubernetes.io/projected/5c6abec5-880a-4d69-bddd-d8e7cfa0e9fa-kube-api-access-n6cdt\") pod \"authorino-operator-657f44b778-d7t2n\" (UID: \"5c6abec5-880a-4d69-bddd-d8e7cfa0e9fa\") " pod="kuadrant-system/authorino-operator-657f44b778-d7t2n"
May 28 18:54:18.371083 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:18.371037    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-d7t2n"
May 28 18:54:18.501114 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:18.501089    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-d7t2n"]
May 28 18:54:18.503175 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:54:18.503149    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6abec5_880a_4d69_bddd_d8e7cfa0e9fa.slice/crio-7cf6a70ccb97cc54f0dd8b2395cfa22f64d962fe7b6984159aca134780b03358 WatchSource:0}: Error finding container 7cf6a70ccb97cc54f0dd8b2395cfa22f64d962fe7b6984159aca134780b03358: Status 404 returned error can't find the container with id 7cf6a70ccb97cc54f0dd8b2395cfa22f64d962fe7b6984159aca134780b03358
May 28 18:54:18.781645 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:18.781558    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-d7t2n" event={"ID":"5c6abec5-880a-4d69-bddd-d8e7cfa0e9fa","Type":"ContainerStarted","Data":"7cf6a70ccb97cc54f0dd8b2395cfa22f64d962fe7b6984159aca134780b03358"}
May 28 18:54:21.794687 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:21.794592    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-d7t2n" event={"ID":"5c6abec5-880a-4d69-bddd-d8e7cfa0e9fa","Type":"ContainerStarted","Data":"01f366d402a6605ebdc5e7e765b28aeea6ac90555da48369857ff5e84dfbab79"}
May 28 18:54:21.794687 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:21.794646    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-d7t2n"
May 28 18:54:21.810747 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:21.810700    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-d7t2n" podStartSLOduration=0.937300416 podStartE2EDuration="3.810687425s" podCreationTimestamp="2026-05-28 18:54:18 +0000 UTC" firstStartedPulling="2026-05-28 18:54:18.505732315 +0000 UTC m=+503.065507261" lastFinishedPulling="2026-05-28 18:54:21.379119323 +0000 UTC m=+505.938894270" observedRunningTime="2026-05-28 18:54:21.809268803 +0000 UTC m=+506.369043773" watchObservedRunningTime="2026-05-28 18:54:21.810687425 +0000 UTC m=+506.370462459"
May 28 18:54:25.772586 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:25.772554    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"
May 28 18:54:27.728160 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:27.728124    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"]
May 28 18:54:27.728623 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:27.728460    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82" podUID="333dbfae-b376-4673-8fb9-f5a3becc7cdc" containerName="manager" containerID="cri-o://46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97" gracePeriod=2
May 28 18:54:27.741613 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:27.741584    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"]
May 28 18:54:27.969144 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:27.969105    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"
May 28 18:54:27.970691 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:27.970661    2572 status_manager.go:895] "Failed to get status for pod" podUID="333dbfae-b376-4673-8fb9-f5a3becc7cdc" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82" err="pods \"limitador-operator-controller-manager-85c4996f8c-s8d82\" is forbidden: User \"system:node:ip-10-0-134-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-108.ec2.internal' and this object"
May 28 18:54:28.012905 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.012826    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnc49\" (UniqueName: \"kubernetes.io/projected/333dbfae-b376-4673-8fb9-f5a3becc7cdc-kube-api-access-rnc49\") pod \"333dbfae-b376-4673-8fb9-f5a3becc7cdc\" (UID: \"333dbfae-b376-4673-8fb9-f5a3becc7cdc\") "
May 28 18:54:28.014872 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.014846    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/333dbfae-b376-4673-8fb9-f5a3becc7cdc-kube-api-access-rnc49" (OuterVolumeSpecName: "kube-api-access-rnc49") pod "333dbfae-b376-4673-8fb9-f5a3becc7cdc" (UID: "333dbfae-b376-4673-8fb9-f5a3becc7cdc"). InnerVolumeSpecName "kube-api-access-rnc49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:54:28.061831 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.061802    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="333dbfae-b376-4673-8fb9-f5a3becc7cdc" path="/var/lib/kubelet/pods/333dbfae-b376-4673-8fb9-f5a3becc7cdc/volumes"
May 28 18:54:28.114007 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.113976    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnc49\" (UniqueName: \"kubernetes.io/projected/333dbfae-b376-4673-8fb9-f5a3becc7cdc-kube-api-access-rnc49\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:54:28.605875 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.605839    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"]
May 28 18:54:28.606225 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.606213    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="333dbfae-b376-4673-8fb9-f5a3becc7cdc" containerName="manager"
May 28 18:54:28.606271 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.606227    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="333dbfae-b376-4673-8fb9-f5a3becc7cdc" containerName="manager"
May 28 18:54:28.606307 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.606278    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="333dbfae-b376-4673-8fb9-f5a3becc7cdc" containerName="manager"
May 28 18:54:28.609561 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.609546    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 18:54:28.613221 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.613197    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zzds7\""
May 28 18:54:28.624013 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.623990    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"]
May 28 18:54:28.719056 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.719019    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca76fe2-be26-49c3-939d-a82c4a477582-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wn4dl\" (UID: \"cca76fe2-be26-49c3-939d-a82c4a477582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 18:54:28.719231 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.719138    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knsfh\" (UniqueName: \"kubernetes.io/projected/cca76fe2-be26-49c3-939d-a82c4a477582-kube-api-access-knsfh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wn4dl\" (UID: \"cca76fe2-be26-49c3-939d-a82c4a477582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 18:54:28.819800 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.819767    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca76fe2-be26-49c3-939d-a82c4a477582-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wn4dl\" (UID: \"cca76fe2-be26-49c3-939d-a82c4a477582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 18:54:28.820229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.819843    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knsfh\" (UniqueName: \"kubernetes.io/projected/cca76fe2-be26-49c3-939d-a82c4a477582-kube-api-access-knsfh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wn4dl\" (UID: \"cca76fe2-be26-49c3-939d-a82c4a477582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 18:54:28.820229 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.820160    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca76fe2-be26-49c3-939d-a82c4a477582-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wn4dl\" (UID: \"cca76fe2-be26-49c3-939d-a82c4a477582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 18:54:28.823127 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.823094    2572 generic.go:358] "Generic (PLEG): container finished" podID="333dbfae-b376-4673-8fb9-f5a3becc7cdc" containerID="46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97" exitCode=0
May 28 18:54:28.823254 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.823156    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-s8d82"
May 28 18:54:28.823254 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.823193    2572 scope.go:117] "RemoveContainer" containerID="46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97"
May 28 18:54:28.831538 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.831517    2572 scope.go:117] "RemoveContainer" containerID="46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97"
May 28 18:54:28.831792 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:54:28.831774    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97\": container with ID starting with 46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97 not found: ID does not exist" containerID="46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97"
May 28 18:54:28.831835 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.831799    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97"} err="failed to get container status \"46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97\": rpc error: code = NotFound desc = could not find container \"46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97\": container with ID starting with 46b860ad23bf38606662ea60cb5800c368fab67ea3d42ff576195fea91486e97 not found: ID does not exist"
May 28 18:54:28.836097 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.836080    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knsfh\" (UniqueName: \"kubernetes.io/projected/cca76fe2-be26-49c3-939d-a82c4a477582-kube-api-access-knsfh\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wn4dl\" (UID: \"cca76fe2-be26-49c3-939d-a82c4a477582\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 18:54:28.920444 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:28.920324    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 18:54:29.061072 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:29.061047    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"]
May 28 18:54:29.062963 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:54:29.062934    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca76fe2_be26_49c3_939d_a82c4a477582.slice/crio-d6ce077aebba7b393b842e13c9769b10790c10c286f054c981c7c69e83929e34 WatchSource:0}: Error finding container d6ce077aebba7b393b842e13c9769b10790c10c286f054c981c7c69e83929e34: Status 404 returned error can't find the container with id d6ce077aebba7b393b842e13c9769b10790c10c286f054c981c7c69e83929e34
May 28 18:54:29.828032 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:29.827994    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl" event={"ID":"cca76fe2-be26-49c3-939d-a82c4a477582","Type":"ContainerStarted","Data":"d6ce077aebba7b393b842e13c9769b10790c10c286f054c981c7c69e83929e34"}
May 28 18:54:32.802185 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:32.802156    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-d7t2n"
May 28 18:54:32.845049 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:32.844961    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl" event={"ID":"cca76fe2-be26-49c3-939d-a82c4a477582","Type":"ContainerStarted","Data":"1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0"}
May 28 18:54:32.845049 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:32.845005    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 18:54:32.862939 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:32.862884    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl" podStartSLOduration=1.333083671 podStartE2EDuration="4.862866208s" podCreationTimestamp="2026-05-28 18:54:28 +0000 UTC" firstStartedPulling="2026-05-28 18:54:29.065289802 +0000 UTC m=+513.625064749" lastFinishedPulling="2026-05-28 18:54:32.595072336 +0000 UTC m=+517.154847286" observedRunningTime="2026-05-28 18:54:32.861112199 +0000 UTC m=+517.420887167" watchObservedRunningTime="2026-05-28 18:54:32.862866208 +0000 UTC m=+517.422641177"
May 28 18:54:37.846534 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:37.846477    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6569b5f748-frlcn" podUID="83802f71-764a-4ad8-95d5-c4b681296b4b" containerName="console" containerID="cri-o://432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887" gracePeriod=15
May 28 18:54:38.090341 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.090319    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6569b5f748-frlcn_83802f71-764a-4ad8-95d5-c4b681296b4b/console/0.log"
May 28 18:54:38.090480 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.090378    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:54:38.207306 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.207216    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-console-config\") pod \"83802f71-764a-4ad8-95d5-c4b681296b4b\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") "
May 28 18:54:38.207306 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.207262    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-service-ca\") pod \"83802f71-764a-4ad8-95d5-c4b681296b4b\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") "
May 28 18:54:38.207306 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.207288    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-oauth-config\") pod \"83802f71-764a-4ad8-95d5-c4b681296b4b\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") "
May 28 18:54:38.207306 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.207308    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-trusted-ca-bundle\") pod \"83802f71-764a-4ad8-95d5-c4b681296b4b\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") "
May 28 18:54:38.207643 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.207343    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/83802f71-764a-4ad8-95d5-c4b681296b4b-kube-api-access-ctl7k\") pod \"83802f71-764a-4ad8-95d5-c4b681296b4b\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") "
May 28 18:54:38.207643 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.207365    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-serving-cert\") pod \"83802f71-764a-4ad8-95d5-c4b681296b4b\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") "
May 28 18:54:38.207643 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.207412    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-oauth-serving-cert\") pod \"83802f71-764a-4ad8-95d5-c4b681296b4b\" (UID: \"83802f71-764a-4ad8-95d5-c4b681296b4b\") "
May 28 18:54:38.207796 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.207686    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-console-config" (OuterVolumeSpecName: "console-config") pod "83802f71-764a-4ad8-95d5-c4b681296b4b" (UID: "83802f71-764a-4ad8-95d5-c4b681296b4b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:54:38.207872 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.207758    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "83802f71-764a-4ad8-95d5-c4b681296b4b" (UID: "83802f71-764a-4ad8-95d5-c4b681296b4b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:54:38.207994 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.207949    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-service-ca" (OuterVolumeSpecName: "service-ca") pod "83802f71-764a-4ad8-95d5-c4b681296b4b" (UID: "83802f71-764a-4ad8-95d5-c4b681296b4b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:54:38.207994 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.207944    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "83802f71-764a-4ad8-95d5-c4b681296b4b" (UID: "83802f71-764a-4ad8-95d5-c4b681296b4b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:54:38.209490 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.209461    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "83802f71-764a-4ad8-95d5-c4b681296b4b" (UID: "83802f71-764a-4ad8-95d5-c4b681296b4b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:54:38.209586 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.209505    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "83802f71-764a-4ad8-95d5-c4b681296b4b" (UID: "83802f71-764a-4ad8-95d5-c4b681296b4b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:54:38.209586 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.209557    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83802f71-764a-4ad8-95d5-c4b681296b4b-kube-api-access-ctl7k" (OuterVolumeSpecName: "kube-api-access-ctl7k") pod "83802f71-764a-4ad8-95d5-c4b681296b4b" (UID: "83802f71-764a-4ad8-95d5-c4b681296b4b"). InnerVolumeSpecName "kube-api-access-ctl7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:54:38.308866 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.308829    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-serving-cert\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:54:38.308866 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.308860    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-oauth-serving-cert\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:54:38.308866 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.308872    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-console-config\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:54:38.309099 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.308885    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-service-ca\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:54:38.309099 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.308895    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83802f71-764a-4ad8-95d5-c4b681296b4b-console-oauth-config\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:54:38.309099 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.308907    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/83802f71-764a-4ad8-95d5-c4b681296b4b-trusted-ca-bundle\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:54:38.309099 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.308919    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctl7k\" (UniqueName: \"kubernetes.io/projected/83802f71-764a-4ad8-95d5-c4b681296b4b-kube-api-access-ctl7k\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:54:38.869270 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.869239    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6569b5f748-frlcn_83802f71-764a-4ad8-95d5-c4b681296b4b/console/0.log"
May 28 18:54:38.869752 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.869281    2572 generic.go:358] "Generic (PLEG): container finished" podID="83802f71-764a-4ad8-95d5-c4b681296b4b" containerID="432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887" exitCode=2
May 28 18:54:38.869752 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.869345    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6569b5f748-frlcn"
May 28 18:54:38.869752 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.869346    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6569b5f748-frlcn" event={"ID":"83802f71-764a-4ad8-95d5-c4b681296b4b","Type":"ContainerDied","Data":"432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887"}
May 28 18:54:38.869752 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.869411    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6569b5f748-frlcn" event={"ID":"83802f71-764a-4ad8-95d5-c4b681296b4b","Type":"ContainerDied","Data":"e70938b7035b5524cbaa2238a666f4f5c2efd9006e3754e179234219289c2d8c"}
May 28 18:54:38.869752 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.869421    2572 scope.go:117] "RemoveContainer" containerID="432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887"
May 28 18:54:38.879002 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.878984    2572 scope.go:117] "RemoveContainer" containerID="432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887"
May 28 18:54:38.879263 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:54:38.879244    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887\": container with ID starting with 432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887 not found: ID does not exist" containerID="432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887"
May 28 18:54:38.879331 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.879270    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887"} err="failed to get container status \"432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887\": rpc error: code = NotFound desc = could not find container \"432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887\": container with ID starting with 432f7bf9433bd4d63f6b0b82845d55436bfadda0fc9a1c900508f862117dd887 not found: ID does not exist"
May 28 18:54:38.890852 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.890832    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6569b5f748-frlcn"]
May 28 18:54:38.894303 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:38.894285    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6569b5f748-frlcn"]
May 28 18:54:40.061134 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:40.061098    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83802f71-764a-4ad8-95d5-c4b681296b4b" path="/var/lib/kubelet/pods/83802f71-764a-4ad8-95d5-c4b681296b4b/volumes"
May 28 18:54:43.851742 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:54:43.851710    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 18:55:00.156496 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.156462    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"]
May 28 18:55:00.157019 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.156998    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83802f71-764a-4ad8-95d5-c4b681296b4b" containerName="console"
May 28 18:55:00.157102 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.157022    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="83802f71-764a-4ad8-95d5-c4b681296b4b" containerName="console"
May 28 18:55:00.157162 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.157133    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="83802f71-764a-4ad8-95d5-c4b681296b4b" containerName="console"
May 28 18:55:00.165839 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.165811    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.167789 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.167765    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-95mqn\""
May 28 18:55:00.169167 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.169144    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"]
May 28 18:55:00.307270 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.307231    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.307270 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.307271    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.307512 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.307341    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.307512 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.307426    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.307512 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.307471    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k74cw\" (UniqueName: \"kubernetes.io/projected/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-kube-api-access-k74cw\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.307616 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.307527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.307616 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.307566    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.307616 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.307586    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.307616 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.307612    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.408738 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.408640    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.408738 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.408709    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.408970 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.408753    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k74cw\" (UniqueName: \"kubernetes.io/projected/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-kube-api-access-k74cw\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.408970 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.408785    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.408970 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.408826    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.408970 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.408859    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.408970 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.408893    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.408970 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.408921    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.408970 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.408950    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.409338 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.409051    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.409338 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.409316    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.409490 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.409467    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.409490 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.409478    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.409622 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.409601    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.411326 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.411306    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.411468 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.411396    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.415901 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.415876    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.416022 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.415943    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k74cw\" (UniqueName: \"kubernetes.io/projected/265ebe3f-7412-4de0-ae2d-e5c35d45e5cd-kube-api-access-k74cw\") pod \"maas-default-gateway-openshift-default-7df95f575-lh8gt\" (UID: \"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.478837 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.478798    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:00.608331 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.608301    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"]
May 28 18:55:00.609579 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:55:00.609556    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod265ebe3f_7412_4de0_ae2d_e5c35d45e5cd.slice/crio-013610e00f091cc198786a165cdd529c1f7cb558479cf0262713c51915200156 WatchSource:0}: Error finding container 013610e00f091cc198786a165cdd529c1f7cb558479cf0262713c51915200156: Status 404 returned error can't find the container with id 013610e00f091cc198786a165cdd529c1f7cb558479cf0262713c51915200156
May 28 18:55:00.612124 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.612092    2572 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:55:00.612190 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.612154    2572 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:55:00.612190 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.612185    2572 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:55:00.957249 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.957162    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt" event={"ID":"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd","Type":"ContainerStarted","Data":"6bb60ea3f160711bbb1801a96e355f683fdbf9876ebcb54850a75b985a96158d"}
May 28 18:55:00.957249 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.957198    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt" event={"ID":"265ebe3f-7412-4de0-ae2d-e5c35d45e5cd","Type":"ContainerStarted","Data":"013610e00f091cc198786a165cdd529c1f7cb558479cf0262713c51915200156"}
May 28 18:55:00.985714 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:00.985661    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt" podStartSLOduration=0.98564682 podStartE2EDuration="985.64682ms" podCreationTimestamp="2026-05-28 18:55:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:55:00.983030611 +0000 UTC m=+545.542805579" watchObservedRunningTime="2026-05-28 18:55:00.98564682 +0000 UTC m=+545.545421787"
May 28 18:55:01.479255 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:01.479213    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:01.484406 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:01.484363    2572 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:01.963660 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:01.963627    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:01.964738 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:01.964717    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-lh8gt"
May 28 18:55:05.139007 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:05.138970    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qt5bz"]
May 28 18:55:05.142598 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:05.142577    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qt5bz"
May 28 18:55:05.144824 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:05.144798    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x84cz\""
May 28 18:55:05.147189 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:05.147165    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qt5bz"]
May 28 18:55:05.255736 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:05.255701    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztfds\" (UniqueName: \"kubernetes.io/projected/d2042326-f685-4166-832b-1dc12a014699-kube-api-access-ztfds\") pod \"authorino-f99f4b5cd-qt5bz\" (UID: \"d2042326-f685-4166-832b-1dc12a014699\") " pod="kuadrant-system/authorino-f99f4b5cd-qt5bz"
May 28 18:55:05.357110 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:05.357076    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ztfds\" (UniqueName: \"kubernetes.io/projected/d2042326-f685-4166-832b-1dc12a014699-kube-api-access-ztfds\") pod \"authorino-f99f4b5cd-qt5bz\" (UID: \"d2042326-f685-4166-832b-1dc12a014699\") " pod="kuadrant-system/authorino-f99f4b5cd-qt5bz"
May 28 18:55:05.364295 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:05.364267    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztfds\" (UniqueName: \"kubernetes.io/projected/d2042326-f685-4166-832b-1dc12a014699-kube-api-access-ztfds\") pod \"authorino-f99f4b5cd-qt5bz\" (UID: \"d2042326-f685-4166-832b-1dc12a014699\") " pod="kuadrant-system/authorino-f99f4b5cd-qt5bz"
May 28 18:55:05.453919 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:05.453841    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qt5bz"
May 28 18:55:05.577136 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:05.577113    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qt5bz"]
May 28 18:55:05.579872 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:55:05.579847    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2042326_f685_4166_832b_1dc12a014699.slice/crio-e4f304758192b4edb38e71a0aa37cc05989397b49412f030302be1e7f730dfaf WatchSource:0}: Error finding container e4f304758192b4edb38e71a0aa37cc05989397b49412f030302be1e7f730dfaf: Status 404 returned error can't find the container with id e4f304758192b4edb38e71a0aa37cc05989397b49412f030302be1e7f730dfaf
May 28 18:55:05.981238 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:05.981201    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qt5bz" event={"ID":"d2042326-f685-4166-832b-1dc12a014699","Type":"ContainerStarted","Data":"e4f304758192b4edb38e71a0aa37cc05989397b49412f030302be1e7f730dfaf"}
May 28 18:55:08.997258 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:08.997161    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qt5bz" event={"ID":"d2042326-f685-4166-832b-1dc12a014699","Type":"ContainerStarted","Data":"42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f"}
May 28 18:55:09.013443 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:09.013372    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-qt5bz" podStartSLOduration=0.980698453 podStartE2EDuration="4.01335945s" podCreationTimestamp="2026-05-28 18:55:05 +0000 UTC" firstStartedPulling="2026-05-28 18:55:05.58115943 +0000 UTC m=+550.140934376" lastFinishedPulling="2026-05-28 18:55:08.613820413 +0000 UTC m=+553.173595373" observedRunningTime="2026-05-28 18:55:09.011071681 +0000 UTC m=+553.570846648" watchObservedRunningTime="2026-05-28 18:55:09.01335945 +0000 UTC m=+553.573134467"
May 28 18:55:11.715400 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:11.715351    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qt5bz"]
May 28 18:55:11.715838 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:11.715553    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-qt5bz" podUID="d2042326-f685-4166-832b-1dc12a014699" containerName="authorino" containerID="cri-o://42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f" gracePeriod=30
May 28 18:55:11.957020 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:11.956999    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qt5bz"
May 28 18:55:12.011297 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.011202    2572 generic.go:358] "Generic (PLEG): container finished" podID="d2042326-f685-4166-832b-1dc12a014699" containerID="42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f" exitCode=0
May 28 18:55:12.011297 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.011253    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qt5bz"
May 28 18:55:12.011558 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.011291    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qt5bz" event={"ID":"d2042326-f685-4166-832b-1dc12a014699","Type":"ContainerDied","Data":"42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f"}
May 28 18:55:12.011558 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.011329    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qt5bz" event={"ID":"d2042326-f685-4166-832b-1dc12a014699","Type":"ContainerDied","Data":"e4f304758192b4edb38e71a0aa37cc05989397b49412f030302be1e7f730dfaf"}
May 28 18:55:12.011558 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.011334    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztfds\" (UniqueName: \"kubernetes.io/projected/d2042326-f685-4166-832b-1dc12a014699-kube-api-access-ztfds\") pod \"d2042326-f685-4166-832b-1dc12a014699\" (UID: \"d2042326-f685-4166-832b-1dc12a014699\") "
May 28 18:55:12.011558 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.011351    2572 scope.go:117] "RemoveContainer" containerID="42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f"
May 28 18:55:12.013518 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.013501    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2042326-f685-4166-832b-1dc12a014699-kube-api-access-ztfds" (OuterVolumeSpecName: "kube-api-access-ztfds") pod "d2042326-f685-4166-832b-1dc12a014699" (UID: "d2042326-f685-4166-832b-1dc12a014699"). InnerVolumeSpecName "kube-api-access-ztfds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:55:12.025501 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.025482    2572 scope.go:117] "RemoveContainer" containerID="42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f"
May 28 18:55:12.025763 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:55:12.025742    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f\": container with ID starting with 42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f not found: ID does not exist" containerID="42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f"
May 28 18:55:12.025834 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.025772    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f"} err="failed to get container status \"42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f\": rpc error: code = NotFound desc = could not find container \"42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f\": container with ID starting with 42ddec9864084c8f93d6b9668d11b24bc574123fe746dfd31c319d2a45707b8f not found: ID does not exist"
May 28 18:55:12.113038 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.113009    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztfds\" (UniqueName: \"kubernetes.io/projected/d2042326-f685-4166-832b-1dc12a014699-kube-api-access-ztfds\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:55:12.326557 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.326524    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qt5bz"]
May 28 18:55:12.330062 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:12.330036    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qt5bz"]
May 28 18:55:14.061189 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:14.061155    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2042326-f685-4166-832b-1dc12a014699" path="/var/lib/kubelet/pods/d2042326-f685-4166-832b-1dc12a014699/volumes"
May 28 18:55:37.793994 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:37.793958    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r9pnx"]
May 28 18:55:37.794489 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:37.794371    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2042326-f685-4166-832b-1dc12a014699" containerName="authorino"
May 28 18:55:37.794489 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:37.794397    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2042326-f685-4166-832b-1dc12a014699" containerName="authorino"
May 28 18:55:37.794595 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:37.794508    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2042326-f685-4166-832b-1dc12a014699" containerName="authorino"
May 28 18:55:37.797751 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:37.797732    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r9pnx"
May 28 18:55:37.799602 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:37.799578    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x84cz\""
May 28 18:55:37.802980 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:37.802956    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r9pnx"]
May 28 18:55:37.940264 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:37.940238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d2j6\" (UniqueName: \"kubernetes.io/projected/94a5bc84-70a0-4be4-9326-de73e07ccd08-kube-api-access-6d2j6\") pod \"authorino-8b475cf9f-r9pnx\" (UID: \"94a5bc84-70a0-4be4-9326-de73e07ccd08\") " pod="kuadrant-system/authorino-8b475cf9f-r9pnx"
May 28 18:55:38.023831 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.023799    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r9pnx"]
May 28 18:55:38.024080 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:55:38.024061    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6d2j6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-r9pnx" podUID="94a5bc84-70a0-4be4-9326-de73e07ccd08"
May 28 18:55:38.041569 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.041533    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6d2j6\" (UniqueName: \"kubernetes.io/projected/94a5bc84-70a0-4be4-9326-de73e07ccd08-kube-api-access-6d2j6\") pod \"authorino-8b475cf9f-r9pnx\" (UID: \"94a5bc84-70a0-4be4-9326-de73e07ccd08\") " pod="kuadrant-system/authorino-8b475cf9f-r9pnx"
May 28 18:55:38.049979 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.049910    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77bcc676bd-dx852"]
May 28 18:55:38.052290 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.052268    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d2j6\" (UniqueName: \"kubernetes.io/projected/94a5bc84-70a0-4be4-9326-de73e07ccd08-kube-api-access-6d2j6\") pod \"authorino-8b475cf9f-r9pnx\" (UID: \"94a5bc84-70a0-4be4-9326-de73e07ccd08\") " pod="kuadrant-system/authorino-8b475cf9f-r9pnx"
May 28 18:55:38.053345 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.053327    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77bcc676bd-dx852"
May 28 18:55:38.062881 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.062858    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77bcc676bd-dx852"]
May 28 18:55:38.087945 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.087921    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77bcc676bd-dx852"]
May 28 18:55:38.088146 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:55:38.088129    2572 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-n6wxh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-77bcc676bd-dx852" podUID="377bbd23-bd6c-4caf-a262-ac55e91d1e6d"
May 28 18:55:38.112067 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.112041    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79cdb48b56-hw4mn"]
May 28 18:55:38.115481 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.115461    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77bcc676bd-dx852"
May 28 18:55:38.115577 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.115484    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79cdb48b56-hw4mn"
May 28 18:55:38.115577 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.115462    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r9pnx"
May 28 18:55:38.117326 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.117312    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 28 18:55:38.120614 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.120597    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77bcc676bd-dx852"
May 28 18:55:38.120930 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.120910    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79cdb48b56-hw4mn"]
May 28 18:55:38.124398 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.124368    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r9pnx"
May 28 18:55:38.142369 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.142345    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6wxh\" (UniqueName: \"kubernetes.io/projected/377bbd23-bd6c-4caf-a262-ac55e91d1e6d-kube-api-access-n6wxh\") pod \"authorino-77bcc676bd-dx852\" (UID: \"377bbd23-bd6c-4caf-a262-ac55e91d1e6d\") " pod="kuadrant-system/authorino-77bcc676bd-dx852"
May 28 18:55:38.243604 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.243573    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d2j6\" (UniqueName: \"kubernetes.io/projected/94a5bc84-70a0-4be4-9326-de73e07ccd08-kube-api-access-6d2j6\") pod \"94a5bc84-70a0-4be4-9326-de73e07ccd08\" (UID: \"94a5bc84-70a0-4be4-9326-de73e07ccd08\") "
May 28 18:55:38.243757 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.243731    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6wxh\" (UniqueName: \"kubernetes.io/projected/377bbd23-bd6c-4caf-a262-ac55e91d1e6d-kube-api-access-n6wxh\") pod \"authorino-77bcc676bd-dx852\" (UID: \"377bbd23-bd6c-4caf-a262-ac55e91d1e6d\") " pod="kuadrant-system/authorino-77bcc676bd-dx852"
May 28 18:55:38.243805 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.243781    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-tls-cert\") pod \"authorino-79cdb48b56-hw4mn\" (UID: \"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2\") " pod="kuadrant-system/authorino-79cdb48b56-hw4mn"
May 28 18:55:38.243805 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.243796    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txbwn\" (UniqueName: \"kubernetes.io/projected/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-kube-api-access-txbwn\") pod \"authorino-79cdb48b56-hw4mn\" (UID: \"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2\") " pod="kuadrant-system/authorino-79cdb48b56-hw4mn"
May 28 18:55:38.245663 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.245640    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a5bc84-70a0-4be4-9326-de73e07ccd08-kube-api-access-6d2j6" (OuterVolumeSpecName: "kube-api-access-6d2j6") pod "94a5bc84-70a0-4be4-9326-de73e07ccd08" (UID: "94a5bc84-70a0-4be4-9326-de73e07ccd08"). InnerVolumeSpecName "kube-api-access-6d2j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:55:38.250921 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.250899    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6wxh\" (UniqueName: \"kubernetes.io/projected/377bbd23-bd6c-4caf-a262-ac55e91d1e6d-kube-api-access-n6wxh\") pod \"authorino-77bcc676bd-dx852\" (UID: \"377bbd23-bd6c-4caf-a262-ac55e91d1e6d\") " pod="kuadrant-system/authorino-77bcc676bd-dx852"
May 28 18:55:38.345239 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.345197    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6wxh\" (UniqueName: \"kubernetes.io/projected/377bbd23-bd6c-4caf-a262-ac55e91d1e6d-kube-api-access-n6wxh\") pod \"377bbd23-bd6c-4caf-a262-ac55e91d1e6d\" (UID: \"377bbd23-bd6c-4caf-a262-ac55e91d1e6d\") "
May 28 18:55:38.345436 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.345418    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-tls-cert\") pod \"authorino-79cdb48b56-hw4mn\" (UID: \"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2\") " pod="kuadrant-system/authorino-79cdb48b56-hw4mn"
May 28 18:55:38.345493 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.345440    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txbwn\" (UniqueName: \"kubernetes.io/projected/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-kube-api-access-txbwn\") pod \"authorino-79cdb48b56-hw4mn\" (UID: \"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2\") " pod="kuadrant-system/authorino-79cdb48b56-hw4mn"
May 28 18:55:38.345528 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.345512    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d2j6\" (UniqueName: \"kubernetes.io/projected/94a5bc84-70a0-4be4-9326-de73e07ccd08-kube-api-access-6d2j6\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:55:38.347149 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.347116    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/377bbd23-bd6c-4caf-a262-ac55e91d1e6d-kube-api-access-n6wxh" (OuterVolumeSpecName: "kube-api-access-n6wxh") pod "377bbd23-bd6c-4caf-a262-ac55e91d1e6d" (UID: "377bbd23-bd6c-4caf-a262-ac55e91d1e6d"). InnerVolumeSpecName "kube-api-access-n6wxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:55:38.347608 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.347584    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-tls-cert\") pod \"authorino-79cdb48b56-hw4mn\" (UID: \"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2\") " pod="kuadrant-system/authorino-79cdb48b56-hw4mn"
May 28 18:55:38.351735 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.351711    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txbwn\" (UniqueName: \"kubernetes.io/projected/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-kube-api-access-txbwn\") pod \"authorino-79cdb48b56-hw4mn\" (UID: \"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2\") " pod="kuadrant-system/authorino-79cdb48b56-hw4mn"
May 28 18:55:38.432649 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.432614    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79cdb48b56-hw4mn"
May 28 18:55:38.446858 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.446829    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6wxh\" (UniqueName: \"kubernetes.io/projected/377bbd23-bd6c-4caf-a262-ac55e91d1e6d-kube-api-access-n6wxh\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:55:38.557052 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:38.557027    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79cdb48b56-hw4mn"]
May 28 18:55:38.559032 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:55:38.559008    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c6de0bc_f1dd_4896_bceb_dbe87a27c2b2.slice/crio-ff0eba6f38c46bda714063e051e9f621e513b9d94b92df19d0b820d215e587ad WatchSource:0}: Error finding container ff0eba6f38c46bda714063e051e9f621e513b9d94b92df19d0b820d215e587ad: Status 404 returned error can't find the container with id ff0eba6f38c46bda714063e051e9f621e513b9d94b92df19d0b820d215e587ad
May 28 18:55:39.120103 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:39.120068    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79cdb48b56-hw4mn" event={"ID":"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2","Type":"ContainerStarted","Data":"40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808"}
May 28 18:55:39.120630 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:39.120109    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79cdb48b56-hw4mn" event={"ID":"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2","Type":"ContainerStarted","Data":"ff0eba6f38c46bda714063e051e9f621e513b9d94b92df19d0b820d215e587ad"}
May 28 18:55:39.120630 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:39.120200    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77bcc676bd-dx852"
May 28 18:55:39.120630 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:39.120226    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-r9pnx"
May 28 18:55:39.134584 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:39.134541    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-79cdb48b56-hw4mn" podStartSLOduration=0.800758953 podStartE2EDuration="1.134528887s" podCreationTimestamp="2026-05-28 18:55:38 +0000 UTC" firstStartedPulling="2026-05-28 18:55:38.560246975 +0000 UTC m=+583.120021921" lastFinishedPulling="2026-05-28 18:55:38.894016907 +0000 UTC m=+583.453791855" observedRunningTime="2026-05-28 18:55:39.13283519 +0000 UTC m=+583.692610158" watchObservedRunningTime="2026-05-28 18:55:39.134528887 +0000 UTC m=+583.694303866"
May 28 18:55:39.156336 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:39.156271    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r9pnx"]
May 28 18:55:39.167818 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:39.167784    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-r9pnx"]
May 28 18:55:39.191892 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:39.191851    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77bcc676bd-dx852"]
May 28 18:55:39.194166 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:39.194143    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77bcc676bd-dx852"]
May 28 18:55:40.063137 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:40.063106    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="377bbd23-bd6c-4caf-a262-ac55e91d1e6d" path="/var/lib/kubelet/pods/377bbd23-bd6c-4caf-a262-ac55e91d1e6d/volumes"
May 28 18:55:40.063343 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:40.063331    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94a5bc84-70a0-4be4-9326-de73e07ccd08" path="/var/lib/kubelet/pods/94a5bc84-70a0-4be4-9326-de73e07ccd08/volumes"
May 28 18:55:55.993641 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:55.993613    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 18:55:55.994112 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:55:55.993931    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 18:57:10.872078 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.872046    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"]
May 28 18:57:10.875728 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.875709    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:10.878175 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.878154    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t4krc\""
May 28 18:57:10.878734 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.878715    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 28 18:57:10.878822 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.878735    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 18:57:10.878822 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.878721    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 18:57:10.885621 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.885597    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"]
May 28 18:57:10.949829 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.949782    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b183dba-180a-4ef6-afb6-20300d25fd0e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:10.949829 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.949828    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:10.950158 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.949929    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:10.950158 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.949962    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:10.950158 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.950011    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:10.950158 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:10.950080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcvfx\" (UniqueName: \"kubernetes.io/projected/4b183dba-180a-4ef6-afb6-20300d25fd0e-kube-api-access-hcvfx\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.051263 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.051233    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcvfx\" (UniqueName: \"kubernetes.io/projected/4b183dba-180a-4ef6-afb6-20300d25fd0e-kube-api-access-hcvfx\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.051478 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.051309    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b183dba-180a-4ef6-afb6-20300d25fd0e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.051478 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.051357    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.051478 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.051421    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.051478 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.051452    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.051685 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.051514    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.051959 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.051930    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.052094 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.051989    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.052094 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.052045    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.053771 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.053752    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b183dba-180a-4ef6-afb6-20300d25fd0e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.054128 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.054106    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b183dba-180a-4ef6-afb6-20300d25fd0e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.058256 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.058227    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcvfx\" (UniqueName: \"kubernetes.io/projected/4b183dba-180a-4ef6-afb6-20300d25fd0e-kube-api-access-hcvfx\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-74q6c\" (UID: \"4b183dba-180a-4ef6-afb6-20300d25fd0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.186252 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.186164    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:11.331777 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.331749    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"]
May 28 18:57:11.338183 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.338157    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:57:11.482906 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:11.482818    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c" event={"ID":"4b183dba-180a-4ef6-afb6-20300d25fd0e","Type":"ContainerStarted","Data":"b85d9b490279a60ce92f3fb62b1d50457a90e55056109d015458e64d8c351353"}
May 28 18:57:17.513959 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:17.513916    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c" event={"ID":"4b183dba-180a-4ef6-afb6-20300d25fd0e","Type":"ContainerStarted","Data":"3e66d76a4d3e2483cafc83aa74dffcdae922ddbab3adf5929fc30ccf518542e3"}
May 28 18:57:25.548071 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:25.548033    2572 generic.go:358] "Generic (PLEG): container finished" podID="4b183dba-180a-4ef6-afb6-20300d25fd0e" containerID="3e66d76a4d3e2483cafc83aa74dffcdae922ddbab3adf5929fc30ccf518542e3" exitCode=0
May 28 18:57:25.548473 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:25.548109    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c" event={"ID":"4b183dba-180a-4ef6-afb6-20300d25fd0e","Type":"ContainerDied","Data":"3e66d76a4d3e2483cafc83aa74dffcdae922ddbab3adf5929fc30ccf518542e3"}
May 28 18:57:27.557911 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:27.557868    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c" event={"ID":"4b183dba-180a-4ef6-afb6-20300d25fd0e","Type":"ContainerStarted","Data":"4c2c69797b75f94ae9d7e8fe2885e8b81e0ebace6361577e3e046723f814ce75"}
May 28 18:57:27.558338 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:27.558079    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:27.575873 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:27.575825    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c" podStartSLOduration=2.193208093 podStartE2EDuration="17.575810744s" podCreationTimestamp="2026-05-28 18:57:10 +0000 UTC" firstStartedPulling="2026-05-28 18:57:11.338326526 +0000 UTC m=+675.898101475" lastFinishedPulling="2026-05-28 18:57:26.720929178 +0000 UTC m=+691.280704126" observedRunningTime="2026-05-28 18:57:27.573148154 +0000 UTC m=+692.132923122" watchObservedRunningTime="2026-05-28 18:57:27.575810744 +0000 UTC m=+692.135585732"
May 28 18:57:38.575299 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:38.575263    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-74q6c"
May 28 18:57:41.963297 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:41.963255    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"]
May 28 18:57:42.162566 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.162534    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.165052 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.165028    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 28 18:57:42.167852 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.167831    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"]
May 28 18:57:42.244733 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.244630    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.244733 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.244690    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.244982 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.244852    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.244982 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.244892    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqn24\" (UniqueName: \"kubernetes.io/projected/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-kube-api-access-rqn24\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.244982 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.244923    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.244982 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.244965    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.345665 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.345637    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.345865 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.345670    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqn24\" (UniqueName: \"kubernetes.io/projected/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-kube-api-access-rqn24\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.345865 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.345696    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.345865 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.345716    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.345865 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.345772    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.345865 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.345798    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.346126 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.346105    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.346210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.346187    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.346267 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.346193    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.347990 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.347961    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.348113 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.348098    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.352567 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.352544    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqn24\" (UniqueName: \"kubernetes.io/projected/2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8-kube-api-access-rqn24\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q\" (UID: \"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.473928 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.473892    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:42.616459 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:42.616426    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"]
May 28 18:57:42.618311 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:57:42.618281    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe5fc4d_7d13_4f17_8ed6_2632b09d90e8.slice/crio-6c86726e940e1c59efa6a8704f2d0367fcf2bbef8820b3f90951a40168fd30cb WatchSource:0}: Error finding container 6c86726e940e1c59efa6a8704f2d0367fcf2bbef8820b3f90951a40168fd30cb: Status 404 returned error can't find the container with id 6c86726e940e1c59efa6a8704f2d0367fcf2bbef8820b3f90951a40168fd30cb
May 28 18:57:43.622155 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:43.622115    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q" event={"ID":"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8","Type":"ContainerStarted","Data":"ed067265bf11df999f81f5c3bb28dbf1d62fec4716f716a1c6b3c9dbfd10fa2a"}
May 28 18:57:43.622155 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:43.622157    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q" event={"ID":"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8","Type":"ContainerStarted","Data":"6c86726e940e1c59efa6a8704f2d0367fcf2bbef8820b3f90951a40168fd30cb"}
May 28 18:57:48.643454 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:48.643420    2572 generic.go:358] "Generic (PLEG): container finished" podID="2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8" containerID="ed067265bf11df999f81f5c3bb28dbf1d62fec4716f716a1c6b3c9dbfd10fa2a" exitCode=0
May 28 18:57:48.643840 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:48.643487    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q" event={"ID":"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8","Type":"ContainerDied","Data":"ed067265bf11df999f81f5c3bb28dbf1d62fec4716f716a1c6b3c9dbfd10fa2a"}
May 28 18:57:49.649613 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:49.649580    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q" event={"ID":"2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8","Type":"ContainerStarted","Data":"6e33e81b86f057a6454c3777de2eb1fd4d66800ec863a285c32fd79f8d4782a9"}
May 28 18:57:49.650006 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:49.649795    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:57:49.670653 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:57:49.670607    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q" podStartSLOduration=8.304238157 podStartE2EDuration="8.670593526s" podCreationTimestamp="2026-05-28 18:57:41 +0000 UTC" firstStartedPulling="2026-05-28 18:57:48.644141557 +0000 UTC m=+713.203916503" lastFinishedPulling="2026-05-28 18:57:49.010496924 +0000 UTC m=+713.570271872" observedRunningTime="2026-05-28 18:57:49.667038376 +0000 UTC m=+714.226813347" watchObservedRunningTime="2026-05-28 18:57:49.670593526 +0000 UTC m=+714.230368494"
May 28 18:58:00.666280 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:00.666252    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q"
May 28 18:58:22.218962 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.218115    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79cdb48b56-hw4mn"]
May 28 18:58:22.218962 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.218476    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-79cdb48b56-hw4mn" podUID="5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2" containerName="authorino" containerID="cri-o://40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808" gracePeriod=30
May 28 18:58:22.469918 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.469866    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79cdb48b56-hw4mn"
May 28 18:58:22.623638 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.623601    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-tls-cert\") pod \"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2\" (UID: \"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2\") "
May 28 18:58:22.623830 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.623696    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txbwn\" (UniqueName: \"kubernetes.io/projected/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-kube-api-access-txbwn\") pod \"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2\" (UID: \"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2\") "
May 28 18:58:22.625623 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.625589    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-kube-api-access-txbwn" (OuterVolumeSpecName: "kube-api-access-txbwn") pod "5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2" (UID: "5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2"). InnerVolumeSpecName "kube-api-access-txbwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:58:22.633830 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.633800    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2" (UID: "5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:58:22.725504 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.725419    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txbwn\" (UniqueName: \"kubernetes.io/projected/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-kube-api-access-txbwn\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:58:22.725504 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.725449    2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2-tls-cert\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 18:58:22.785493 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.785452    2572 generic.go:358] "Generic (PLEG): container finished" podID="5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2" containerID="40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808" exitCode=0
May 28 18:58:22.785493 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.785489    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79cdb48b56-hw4mn" event={"ID":"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2","Type":"ContainerDied","Data":"40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808"}
May 28 18:58:22.785740 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.785505    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79cdb48b56-hw4mn"
May 28 18:58:22.785740 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.785526    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79cdb48b56-hw4mn" event={"ID":"5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2","Type":"ContainerDied","Data":"ff0eba6f38c46bda714063e051e9f621e513b9d94b92df19d0b820d215e587ad"}
May 28 18:58:22.785740 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.785540    2572 scope.go:117] "RemoveContainer" containerID="40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808"
May 28 18:58:22.795561 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.795545    2572 scope.go:117] "RemoveContainer" containerID="40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808"
May 28 18:58:22.795810 ip-10-0-134-108 kubenswrapper[2572]: E0528 18:58:22.795791    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808\": container with ID starting with 40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808 not found: ID does not exist" containerID="40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808"
May 28 18:58:22.795878 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.795818    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808"} err="failed to get container status \"40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808\": rpc error: code = NotFound desc = could not find container \"40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808\": container with ID starting with 40f991d375340a63f8caaa6095af6f3a5f97ee0a1320fa0fbd9b418bdfcf1808 not found: ID does not exist"
May 28 18:58:22.807770 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.807748    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79cdb48b56-hw4mn"]
May 28 18:58:22.811047 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:22.811027    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-79cdb48b56-hw4mn"]
May 28 18:58:24.061884 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:58:24.061853    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2" path="/var/lib/kubelet/pods/5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2/volumes"
May 28 18:59:48.046663 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.046615    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cb7848758-hvrqs"]
May 28 18:59:48.047088 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.047013    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2" containerName="authorino"
May 28 18:59:48.047088 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.047029    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2" containerName="authorino"
May 28 18:59:48.047160 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.047116    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="5c6de0bc-f1dd-4896-bceb-dbe87a27c2b2" containerName="authorino"
May 28 18:59:48.050230 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.050214    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb7848758-hvrqs"
May 28 18:59:48.052492 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.052475    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 18:59:48.052935 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.052916    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wr45w\""
May 28 18:59:48.053021 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.052938    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
May 28 18:59:48.062210 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.062190    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cb7848758-hvrqs"]
May 28 18:59:48.208670 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.208641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb6b98e0-77e5-4fd5-9688-320b578a1ebb-webhook-cert\") pod \"maas-controller-cb7848758-hvrqs\" (UID: \"bb6b98e0-77e5-4fd5-9688-320b578a1ebb\") " pod="opendatahub/maas-controller-cb7848758-hvrqs"
May 28 18:59:48.208876 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.208736    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqhdn\" (UniqueName: \"kubernetes.io/projected/bb6b98e0-77e5-4fd5-9688-320b578a1ebb-kube-api-access-xqhdn\") pod \"maas-controller-cb7848758-hvrqs\" (UID: \"bb6b98e0-77e5-4fd5-9688-320b578a1ebb\") " pod="opendatahub/maas-controller-cb7848758-hvrqs"
May 28 18:59:48.310014 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.309991    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb6b98e0-77e5-4fd5-9688-320b578a1ebb-webhook-cert\") pod \"maas-controller-cb7848758-hvrqs\" (UID: \"bb6b98e0-77e5-4fd5-9688-320b578a1ebb\") " pod="opendatahub/maas-controller-cb7848758-hvrqs"
May 28 18:59:48.310167 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.310053    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqhdn\" (UniqueName: \"kubernetes.io/projected/bb6b98e0-77e5-4fd5-9688-320b578a1ebb-kube-api-access-xqhdn\") pod \"maas-controller-cb7848758-hvrqs\" (UID: \"bb6b98e0-77e5-4fd5-9688-320b578a1ebb\") " pod="opendatahub/maas-controller-cb7848758-hvrqs"
May 28 18:59:48.312432 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.312402    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb6b98e0-77e5-4fd5-9688-320b578a1ebb-webhook-cert\") pod \"maas-controller-cb7848758-hvrqs\" (UID: \"bb6b98e0-77e5-4fd5-9688-320b578a1ebb\") " pod="opendatahub/maas-controller-cb7848758-hvrqs"
May 28 18:59:48.317943 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.317914    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqhdn\" (UniqueName: \"kubernetes.io/projected/bb6b98e0-77e5-4fd5-9688-320b578a1ebb-kube-api-access-xqhdn\") pod \"maas-controller-cb7848758-hvrqs\" (UID: \"bb6b98e0-77e5-4fd5-9688-320b578a1ebb\") " pod="opendatahub/maas-controller-cb7848758-hvrqs"
May 28 18:59:48.362438 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.362402    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cb7848758-hvrqs"
May 28 18:59:48.495137 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:48.495113    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cb7848758-hvrqs"]
May 28 18:59:48.497103 ip-10-0-134-108 kubenswrapper[2572]: W0528 18:59:48.497076    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6b98e0_77e5_4fd5_9688_320b578a1ebb.slice/crio-e02f10940596b08a7e61a403dc00827c3a6c365e6ab275d5bc858a602fa8ccbd WatchSource:0}: Error finding container e02f10940596b08a7e61a403dc00827c3a6c365e6ab275d5bc858a602fa8ccbd: Status 404 returned error can't find the container with id e02f10940596b08a7e61a403dc00827c3a6c365e6ab275d5bc858a602fa8ccbd
May 28 18:59:49.139537 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:49.139494    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb7848758-hvrqs" event={"ID":"bb6b98e0-77e5-4fd5-9688-320b578a1ebb","Type":"ContainerStarted","Data":"e02f10940596b08a7e61a403dc00827c3a6c365e6ab275d5bc858a602fa8ccbd"}
May 28 18:59:51.150211 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:51.150166    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cb7848758-hvrqs" event={"ID":"bb6b98e0-77e5-4fd5-9688-320b578a1ebb","Type":"ContainerStarted","Data":"62be58ee48ffc8df703624393914d4cf39e14e3340be2fb3ce55f4afc02a8ca6"}
May 28 18:59:51.150597 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:51.150220    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cb7848758-hvrqs"
May 28 18:59:51.164209 ip-10-0-134-108 kubenswrapper[2572]: I0528 18:59:51.164152    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-cb7848758-hvrqs" podStartSLOduration=0.663214971 podStartE2EDuration="3.164138044s" podCreationTimestamp="2026-05-28 18:59:48 +0000 UTC" firstStartedPulling="2026-05-28 18:59:48.49837787 +0000 UTC m=+833.058152818" lastFinishedPulling="2026-05-28 18:59:50.999300928 +0000 UTC m=+835.559075891" observedRunningTime="2026-05-28 18:59:51.163256935 +0000 UTC m=+835.723031903" watchObservedRunningTime="2026-05-28 18:59:51.164138044 +0000 UTC m=+835.723913011"
May 28 19:00:00.139532 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:00.139494    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666580-skwkl"]
May 28 19:00:00.142983 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:00.142968    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-skwkl"
May 28 19:00:00.145100 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:00.145076    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ddz7l\""
May 28 19:00:00.149256 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:00.149231    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666580-skwkl"]
May 28 19:00:00.321237 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:00.321183    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwwqj\" (UniqueName: \"kubernetes.io/projected/48657b7a-f9cf-4eda-af70-41654327aaba-kube-api-access-mwwqj\") pod \"maas-api-key-cleanup-29666580-skwkl\" (UID: \"48657b7a-f9cf-4eda-af70-41654327aaba\") " pod="opendatahub/maas-api-key-cleanup-29666580-skwkl"
May 28 19:00:00.421878 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:00.421792    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwwqj\" (UniqueName: \"kubernetes.io/projected/48657b7a-f9cf-4eda-af70-41654327aaba-kube-api-access-mwwqj\") pod \"maas-api-key-cleanup-29666580-skwkl\" (UID: \"48657b7a-f9cf-4eda-af70-41654327aaba\") " pod="opendatahub/maas-api-key-cleanup-29666580-skwkl"
May 28 19:00:00.431559 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:00.431531    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwwqj\" (UniqueName: \"kubernetes.io/projected/48657b7a-f9cf-4eda-af70-41654327aaba-kube-api-access-mwwqj\") pod \"maas-api-key-cleanup-29666580-skwkl\" (UID: \"48657b7a-f9cf-4eda-af70-41654327aaba\") " pod="opendatahub/maas-api-key-cleanup-29666580-skwkl"
May 28 19:00:00.453945 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:00.453921    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-skwkl"
May 28 19:00:00.584904 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:00.584875    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666580-skwkl"]
May 28 19:00:00.586788 ip-10-0-134-108 kubenswrapper[2572]: W0528 19:00:00.586760    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48657b7a_f9cf_4eda_af70_41654327aaba.slice/crio-1917a337cf3d99425004cc65bb07fffe4b56636d551be7f6cdbe8aafaf8d5080 WatchSource:0}: Error finding container 1917a337cf3d99425004cc65bb07fffe4b56636d551be7f6cdbe8aafaf8d5080: Status 404 returned error can't find the container with id 1917a337cf3d99425004cc65bb07fffe4b56636d551be7f6cdbe8aafaf8d5080
May 28 19:00:01.191282 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:01.191238    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666580-skwkl" event={"ID":"48657b7a-f9cf-4eda-af70-41654327aaba","Type":"ContainerStarted","Data":"1917a337cf3d99425004cc65bb07fffe4b56636d551be7f6cdbe8aafaf8d5080"}
May 28 19:00:02.160781 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:02.160748    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cb7848758-hvrqs"
May 28 19:00:04.210640 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:04.210594    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666580-skwkl" event={"ID":"48657b7a-f9cf-4eda-af70-41654327aaba","Type":"ContainerStarted","Data":"5c10a1605778afde9c97741a23625bd0dfbfb21728bfbea1112e9d58bf4d04fd"}
May 28 19:00:04.226719 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:04.226664    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29666580-skwkl" podStartSLOduration=1.06938037 podStartE2EDuration="4.22665021s" podCreationTimestamp="2026-05-28 19:00:00 +0000 UTC" firstStartedPulling="2026-05-28 19:00:00.588595881 +0000 UTC m=+845.148370827" lastFinishedPulling="2026-05-28 19:00:03.745865721 +0000 UTC m=+848.305640667" observedRunningTime="2026-05-28 19:00:04.224927098 +0000 UTC m=+848.784702067" watchObservedRunningTime="2026-05-28 19:00:04.22665021 +0000 UTC m=+848.786425178"
May 28 19:00:05.215770 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:05.215731    2572 generic.go:358] "Generic (PLEG): container finished" podID="48657b7a-f9cf-4eda-af70-41654327aaba" containerID="5c10a1605778afde9c97741a23625bd0dfbfb21728bfbea1112e9d58bf4d04fd" exitCode=0
May 28 19:00:05.216172 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:05.215812    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666580-skwkl" event={"ID":"48657b7a-f9cf-4eda-af70-41654327aaba","Type":"ContainerDied","Data":"5c10a1605778afde9c97741a23625bd0dfbfb21728bfbea1112e9d58bf4d04fd"}
May 28 19:00:06.352539 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:06.352517    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-skwkl"
May 28 19:00:06.376921 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:06.376897    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwwqj\" (UniqueName: \"kubernetes.io/projected/48657b7a-f9cf-4eda-af70-41654327aaba-kube-api-access-mwwqj\") pod \"48657b7a-f9cf-4eda-af70-41654327aaba\" (UID: \"48657b7a-f9cf-4eda-af70-41654327aaba\") "
May 28 19:00:06.379018 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:06.378983    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48657b7a-f9cf-4eda-af70-41654327aaba-kube-api-access-mwwqj" (OuterVolumeSpecName: "kube-api-access-mwwqj") pod "48657b7a-f9cf-4eda-af70-41654327aaba" (UID: "48657b7a-f9cf-4eda-af70-41654327aaba"). InnerVolumeSpecName "kube-api-access-mwwqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:00:06.477600 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:06.477516    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwwqj\" (UniqueName: \"kubernetes.io/projected/48657b7a-f9cf-4eda-af70-41654327aaba-kube-api-access-mwwqj\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 19:00:07.225429 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:07.225402    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-skwkl"
May 28 19:00:07.225429 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:07.225413    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666580-skwkl" event={"ID":"48657b7a-f9cf-4eda-af70-41654327aaba","Type":"ContainerDied","Data":"1917a337cf3d99425004cc65bb07fffe4b56636d551be7f6cdbe8aafaf8d5080"}
May 28 19:00:07.225643 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:07.225450    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1917a337cf3d99425004cc65bb07fffe4b56636d551be7f6cdbe8aafaf8d5080"
May 28 19:00:56.031148 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:56.031121    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 19:00:56.031751 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:00:56.031259    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 19:05:56.074358 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:05:56.074327    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 19:05:56.077778 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:05:56.077760    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 19:10:18.076177 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.076143    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"]
May 28 19:10:18.076697 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.076364    2572 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl" podUID="cca76fe2-be26-49c3-939d-a82c4a477582" containerName="manager" containerID="cri-o://1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0" gracePeriod=10
May 28 19:10:18.328075 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.328017    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 19:10:18.413502 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.413461    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca76fe2-be26-49c3-939d-a82c4a477582-extensions-socket-volume\") pod \"cca76fe2-be26-49c3-939d-a82c4a477582\" (UID: \"cca76fe2-be26-49c3-939d-a82c4a477582\") "
May 28 19:10:18.413671 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.413537    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knsfh\" (UniqueName: \"kubernetes.io/projected/cca76fe2-be26-49c3-939d-a82c4a477582-kube-api-access-knsfh\") pod \"cca76fe2-be26-49c3-939d-a82c4a477582\" (UID: \"cca76fe2-be26-49c3-939d-a82c4a477582\") "
May 28 19:10:18.413898 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.413878    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cca76fe2-be26-49c3-939d-a82c4a477582-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cca76fe2-be26-49c3-939d-a82c4a477582" (UID: "cca76fe2-be26-49c3-939d-a82c4a477582"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:10:18.415583 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.415563    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cca76fe2-be26-49c3-939d-a82c4a477582-kube-api-access-knsfh" (OuterVolumeSpecName: "kube-api-access-knsfh") pod "cca76fe2-be26-49c3-939d-a82c4a477582" (UID: "cca76fe2-be26-49c3-939d-a82c4a477582"). InnerVolumeSpecName "kube-api-access-knsfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:10:18.514724 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.514690    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca76fe2-be26-49c3-939d-a82c4a477582-extensions-socket-volume\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 19:10:18.514724 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.514716    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knsfh\" (UniqueName: \"kubernetes.io/projected/cca76fe2-be26-49c3-939d-a82c4a477582-kube-api-access-knsfh\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 19:10:18.711415 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.711305    2572 generic.go:358] "Generic (PLEG): container finished" podID="cca76fe2-be26-49c3-939d-a82c4a477582" containerID="1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0" exitCode=0
May 28 19:10:18.711576 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.711409    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"
May 28 19:10:18.711576 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.711412    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl" event={"ID":"cca76fe2-be26-49c3-939d-a82c4a477582","Type":"ContainerDied","Data":"1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0"}
May 28 19:10:18.711576 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.711532    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl" event={"ID":"cca76fe2-be26-49c3-939d-a82c4a477582","Type":"ContainerDied","Data":"d6ce077aebba7b393b842e13c9769b10790c10c286f054c981c7c69e83929e34"}
May 28 19:10:18.711576 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.711549    2572 scope.go:117] "RemoveContainer" containerID="1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0"
May 28 19:10:18.720929 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.720912    2572 scope.go:117] "RemoveContainer" containerID="1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0"
May 28 19:10:18.721202 ip-10-0-134-108 kubenswrapper[2572]: E0528 19:10:18.721180    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0\": container with ID starting with 1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0 not found: ID does not exist" containerID="1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0"
May 28 19:10:18.721261 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.721211    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0"} err="failed to get container status \"1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0\": rpc error: code = NotFound desc = could not find container \"1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0\": container with ID starting with 1e174a60bb8681fdb3ef98ec154bc5e7edc47b617d2beb7ab8baffbaeebe93f0 not found: ID does not exist"
May 28 19:10:18.732818 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.732789    2572 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"]
May 28 19:10:18.736484 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:18.736462    2572 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wn4dl"]
May 28 19:10:20.062018 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:20.061984    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cca76fe2-be26-49c3-939d-a82c4a477582" path="/var/lib/kubelet/pods/cca76fe2-be26-49c3-939d-a82c4a477582/volumes"
May 28 19:10:56.109174 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:56.109060    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 19:10:56.113837 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:10:56.113818    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 19:11:24.206966 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.206881    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"]
May 28 19:11:24.207442 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.207325    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca76fe2-be26-49c3-939d-a82c4a477582" containerName="manager"
May 28 19:11:24.207442 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.207338    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca76fe2-be26-49c3-939d-a82c4a477582" containerName="manager"
May 28 19:11:24.207442 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.207352    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48657b7a-f9cf-4eda-af70-41654327aaba" containerName="cleanup"
May 28 19:11:24.207442 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.207358    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="48657b7a-f9cf-4eda-af70-41654327aaba" containerName="cleanup"
May 28 19:11:24.207590 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.207453    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="cca76fe2-be26-49c3-939d-a82c4a477582" containerName="manager"
May 28 19:11:24.207590 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.207464    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="48657b7a-f9cf-4eda-af70-41654327aaba" containerName="cleanup"
May 28 19:11:24.210581 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.210565    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"
May 28 19:11:24.212766 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.212745    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zzds7\""
May 28 19:11:24.221225 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.221201    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"]
May 28 19:11:24.305920 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.305881    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kln72\" (UniqueName: \"kubernetes.io/projected/88c8a299-7ea2-4732-9273-6bc9e8379703-kube-api-access-kln72\") pod \"kuadrant-operator-controller-manager-55c7f4c975-chbk2\" (UID: \"88c8a299-7ea2-4732-9273-6bc9e8379703\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"
May 28 19:11:24.306087 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.305960    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88c8a299-7ea2-4732-9273-6bc9e8379703-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-chbk2\" (UID: \"88c8a299-7ea2-4732-9273-6bc9e8379703\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"
May 28 19:11:24.406868 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.406822    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kln72\" (UniqueName: \"kubernetes.io/projected/88c8a299-7ea2-4732-9273-6bc9e8379703-kube-api-access-kln72\") pod \"kuadrant-operator-controller-manager-55c7f4c975-chbk2\" (UID: \"88c8a299-7ea2-4732-9273-6bc9e8379703\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"
May 28 19:11:24.407071 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.406926    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88c8a299-7ea2-4732-9273-6bc9e8379703-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-chbk2\" (UID: \"88c8a299-7ea2-4732-9273-6bc9e8379703\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"
May 28 19:11:24.407303 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.407283    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/88c8a299-7ea2-4732-9273-6bc9e8379703-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-chbk2\" (UID: \"88c8a299-7ea2-4732-9273-6bc9e8379703\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"
May 28 19:11:24.420639 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.420609    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kln72\" (UniqueName: \"kubernetes.io/projected/88c8a299-7ea2-4732-9273-6bc9e8379703-kube-api-access-kln72\") pod \"kuadrant-operator-controller-manager-55c7f4c975-chbk2\" (UID: \"88c8a299-7ea2-4732-9273-6bc9e8379703\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"
May 28 19:11:24.522357 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.522263    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"
May 28 19:11:24.660253 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.660224    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"]
May 28 19:11:24.662323 ip-10-0-134-108 kubenswrapper[2572]: W0528 19:11:24.662298    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c8a299_7ea2_4732_9273_6bc9e8379703.slice/crio-732b05970feef6a0f2ccf9daa37f159a0fca1bf30207065eff33f73369d5f237 WatchSource:0}: Error finding container 732b05970feef6a0f2ccf9daa37f159a0fca1bf30207065eff33f73369d5f237: Status 404 returned error can't find the container with id 732b05970feef6a0f2ccf9daa37f159a0fca1bf30207065eff33f73369d5f237
May 28 19:11:24.664696 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.664681    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 19:11:24.984865 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.984824    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2" event={"ID":"88c8a299-7ea2-4732-9273-6bc9e8379703","Type":"ContainerStarted","Data":"0071cbcb87b56a7cac7dace11468e7e1c696deb1956ed2218b9595d1be3bc3e3"}
May 28 19:11:24.984865 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.984867    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2" event={"ID":"88c8a299-7ea2-4732-9273-6bc9e8379703","Type":"ContainerStarted","Data":"732b05970feef6a0f2ccf9daa37f159a0fca1bf30207065eff33f73369d5f237"}
May 28 19:11:24.985085 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:24.984897    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"
May 28 19:11:25.006499 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:25.006438    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2" podStartSLOduration=1.006420392 podStartE2EDuration="1.006420392s" podCreationTimestamp="2026-05-28 19:11:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:11:25.003596037 +0000 UTC m=+1529.563371017" watchObservedRunningTime="2026-05-28 19:11:25.006420392 +0000 UTC m=+1529.566195358"
May 28 19:11:35.992084 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:11:35.992052    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-chbk2"
May 28 19:15:00.348656 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:00.348624    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666595-sbvf2"]
May 28 19:15:00.352089 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:00.352071    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666595-sbvf2"
May 28 19:15:00.354964 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:00.354942    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ddz7l\""
May 28 19:15:00.415978 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:00.415942    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ffbk\" (UniqueName: \"kubernetes.io/projected/11abe16f-9e39-46e7-82c4-c7f8704e6187-kube-api-access-7ffbk\") pod \"maas-api-key-cleanup-29666595-sbvf2\" (UID: \"11abe16f-9e39-46e7-82c4-c7f8704e6187\") " pod="opendatahub/maas-api-key-cleanup-29666595-sbvf2"
May 28 19:15:00.464291 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:00.464244    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666595-sbvf2"]
May 28 19:15:00.517409 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:00.517358    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ffbk\" (UniqueName: \"kubernetes.io/projected/11abe16f-9e39-46e7-82c4-c7f8704e6187-kube-api-access-7ffbk\") pod \"maas-api-key-cleanup-29666595-sbvf2\" (UID: \"11abe16f-9e39-46e7-82c4-c7f8704e6187\") " pod="opendatahub/maas-api-key-cleanup-29666595-sbvf2"
May 28 19:15:00.539812 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:00.539785    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ffbk\" (UniqueName: \"kubernetes.io/projected/11abe16f-9e39-46e7-82c4-c7f8704e6187-kube-api-access-7ffbk\") pod \"maas-api-key-cleanup-29666595-sbvf2\" (UID: \"11abe16f-9e39-46e7-82c4-c7f8704e6187\") " pod="opendatahub/maas-api-key-cleanup-29666595-sbvf2"
May 28 19:15:00.661569 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:00.661494    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666595-sbvf2"
May 28 19:15:00.823569 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:00.823543    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666595-sbvf2"]
May 28 19:15:00.825107 ip-10-0-134-108 kubenswrapper[2572]: W0528 19:15:00.825072    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11abe16f_9e39_46e7_82c4_c7f8704e6187.slice/crio-68d587d64f992d60d20a5727f95a67f277cf92a7defea46caa2937f2a3a5fa54 WatchSource:0}: Error finding container 68d587d64f992d60d20a5727f95a67f277cf92a7defea46caa2937f2a3a5fa54: Status 404 returned error can't find the container with id 68d587d64f992d60d20a5727f95a67f277cf92a7defea46caa2937f2a3a5fa54
May 28 19:15:00.883283 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:00.883252    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666595-sbvf2" event={"ID":"11abe16f-9e39-46e7-82c4-c7f8704e6187","Type":"ContainerStarted","Data":"68d587d64f992d60d20a5727f95a67f277cf92a7defea46caa2937f2a3a5fa54"}
May 28 19:15:01.888669 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:01.888637    2572 generic.go:358] "Generic (PLEG): container finished" podID="11abe16f-9e39-46e7-82c4-c7f8704e6187" containerID="00758b889eef35c1cf6651ba930c323d6413e37db24e901c9648cc722b5a56fc" exitCode=0
May 28 19:15:01.889077 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:01.888719    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666595-sbvf2" event={"ID":"11abe16f-9e39-46e7-82c4-c7f8704e6187","Type":"ContainerDied","Data":"00758b889eef35c1cf6651ba930c323d6413e37db24e901c9648cc722b5a56fc"}
May 28 19:15:03.018649 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:03.018627    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666595-sbvf2"
May 28 19:15:03.142297 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:03.142266    2572 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ffbk\" (UniqueName: \"kubernetes.io/projected/11abe16f-9e39-46e7-82c4-c7f8704e6187-kube-api-access-7ffbk\") pod \"11abe16f-9e39-46e7-82c4-c7f8704e6187\" (UID: \"11abe16f-9e39-46e7-82c4-c7f8704e6187\") "
May 28 19:15:03.144315 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:03.144256    2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11abe16f-9e39-46e7-82c4-c7f8704e6187-kube-api-access-7ffbk" (OuterVolumeSpecName: "kube-api-access-7ffbk") pod "11abe16f-9e39-46e7-82c4-c7f8704e6187" (UID: "11abe16f-9e39-46e7-82c4-c7f8704e6187"). InnerVolumeSpecName "kube-api-access-7ffbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:15:03.244089 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:03.244053    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ffbk\" (UniqueName: \"kubernetes.io/projected/11abe16f-9e39-46e7-82c4-c7f8704e6187-kube-api-access-7ffbk\") on node \"ip-10-0-134-108.ec2.internal\" DevicePath \"\""
May 28 19:15:03.897862 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:03.897832    2572 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666595-sbvf2"
May 28 19:15:03.897862 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:03.897854    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666595-sbvf2" event={"ID":"11abe16f-9e39-46e7-82c4-c7f8704e6187","Type":"ContainerDied","Data":"68d587d64f992d60d20a5727f95a67f277cf92a7defea46caa2937f2a3a5fa54"}
May 28 19:15:03.898075 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:03.897881    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68d587d64f992d60d20a5727f95a67f277cf92a7defea46caa2937f2a3a5fa54"
May 28 19:15:56.144862 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:56.144767    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 19:15:56.158483 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:15:56.158451    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 19:20:56.178020 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:20:56.177915    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 19:20:56.193149 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:20:56.193129    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 19:21:14.500725 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:14.500684    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666580-skwkl_48657b7a-f9cf-4eda-af70-41654327aaba/cleanup/0.log"
May 28 19:21:14.610989 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:14.610948    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666595-sbvf2_11abe16f-9e39-46e7-82c4-c7f8704e6187/cleanup/0.log"
May 28 19:21:14.740036 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:14.740000    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cb7848758-hvrqs_bb6b98e0-77e5-4fd5-9688-320b578a1ebb/manager/0.log"
May 28 19:21:14.980172 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:14.980142    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75cc899db8-f8kwm_fd4a1edc-9ba7-4332-a08b-a350d37ae7bb/manager/0.log"
May 28 19:21:16.064475 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.064446    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92_391a33c2-be3c-4de8-ac28-4364fb41b00c/util/0.log"
May 28 19:21:16.070314 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.070295    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92_391a33c2-be3c-4de8-ac28-4364fb41b00c/pull/0.log"
May 28 19:21:16.076211 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.076191    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92_391a33c2-be3c-4de8-ac28-4364fb41b00c/extract/0.log"
May 28 19:21:16.185543 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.185515    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj_ef0725b1-977f-412a-a920-ee8f9d81519f/util/0.log"
May 28 19:21:16.191593 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.191571    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj_ef0725b1-977f-412a-a920-ee8f9d81519f/pull/0.log"
May 28 19:21:16.197474 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.197455    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj_ef0725b1-977f-412a-a920-ee8f9d81519f/extract/0.log"
May 28 19:21:16.302171 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.302145    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm_95a1ef9c-5277-45c7-a3d3-3aa56a1171fb/extract/0.log"
May 28 19:21:16.307674 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.307653    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm_95a1ef9c-5277-45c7-a3d3-3aa56a1171fb/util/0.log"
May 28 19:21:16.312953 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.312935    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm_95a1ef9c-5277-45c7-a3d3-3aa56a1171fb/pull/0.log"
May 28 19:21:16.417493 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.417406    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh_6639d934-9039-4af0-a186-7a601ff03fde/util/0.log"
May 28 19:21:16.423252 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.423234    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh_6639d934-9039-4af0-a186-7a601ff03fde/pull/0.log"
May 28 19:21:16.428814 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.428798    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh_6639d934-9039-4af0-a186-7a601ff03fde/extract/0.log"
May 28 19:21:16.657871 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.657838    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-d7t2n_5c6abec5-880a-4d69-bddd-d8e7cfa0e9fa/manager/0.log"
May 28 19:21:16.987064 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:16.987031    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8cj96_b5873e08-94e6-468a-8795-0673b59f77e2/registry-server/0.log"
May 28 19:21:17.108249 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:17.108209    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-chbk2_88c8a299-7ea2-4732-9273-6bc9e8379703/manager/0.log"
May 28 19:21:17.694538 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:17.694509    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8s5f9g_c1f8f2e1-821c-499d-a23c-f30c27d3f9c5/istio-proxy/0.log"
May 28 19:21:18.147578 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:18.147549    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-lh8gt_265ebe3f-7412-4de0-ae2d-e5c35d45e5cd/istio-proxy/0.log"
May 28 19:21:18.381143 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:18.381112    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bf65b588-4dn44_d7c2a0b3-a9e0-4fca-8859-68305375a968/router/0.log"
May 28 19:21:19.196117 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:19.196086    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q_2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8/main/0.log"
May 28 19:21:19.203837 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:19.203813    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-pdw8q_2fe5fc4d-7d13-4f17-8ed6-2632b09d90e8/storage-initializer/0.log"
May 28 19:21:19.310117 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:19.310089    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-74q6c_4b183dba-180a-4ef6-afb6-20300d25fd0e/storage-initializer/0.log"
May 28 19:21:19.317513 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:19.317489    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-74q6c_4b183dba-180a-4ef6-afb6-20300d25fd0e/main/0.log"
May 28 19:21:26.085399 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:26.085364    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l69q6_3aaf0568-b48b-4790-8937-095380de3826/global-pull-secret-syncer/0.log"
May 28 19:21:26.141805 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:26.141770    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dscsk_f7a43270-977b-4b7c-9832-872e8b54fa72/konnectivity-agent/0.log"
May 28 19:21:26.230688 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:26.230661    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-108.ec2.internal_c85ec789d0afbde36d31782bf9a2e069/haproxy/0.log"
May 28 19:21:29.902354 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:29.902324    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92_391a33c2-be3c-4de8-ac28-4364fb41b00c/extract/0.log"
May 28 19:21:29.922448 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:29.922426    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92_391a33c2-be3c-4de8-ac28-4364fb41b00c/util/0.log"
May 28 19:21:29.943679 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:29.943646    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ctg92_391a33c2-be3c-4de8-ac28-4364fb41b00c/pull/0.log"
May 28 19:21:29.968459 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:29.968438    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj_ef0725b1-977f-412a-a920-ee8f9d81519f/extract/0.log"
May 28 19:21:29.990946 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:29.990923    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj_ef0725b1-977f-412a-a920-ee8f9d81519f/util/0.log"
May 28 19:21:30.015260 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:30.015232    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hdmxj_ef0725b1-977f-412a-a920-ee8f9d81519f/pull/0.log"
May 28 19:21:30.047500 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:30.047477    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm_95a1ef9c-5277-45c7-a3d3-3aa56a1171fb/extract/0.log"
May 28 19:21:30.079248 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:30.079227    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm_95a1ef9c-5277-45c7-a3d3-3aa56a1171fb/util/0.log"
May 28 19:21:30.127460 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:30.127437    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739jrtm_95a1ef9c-5277-45c7-a3d3-3aa56a1171fb/pull/0.log"
May 28 19:21:30.173238 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:30.173171    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh_6639d934-9039-4af0-a186-7a601ff03fde/extract/0.log"
May 28 19:21:30.204256 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:30.204233    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh_6639d934-9039-4af0-a186-7a601ff03fde/util/0.log"
May 28 19:21:30.227758 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:30.227736    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bnpqh_6639d934-9039-4af0-a186-7a601ff03fde/pull/0.log"
May 28 19:21:30.518685 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:30.518601    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-d7t2n_5c6abec5-880a-4d69-bddd-d8e7cfa0e9fa/manager/0.log"
May 28 19:21:30.612075 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:30.612043    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8cj96_b5873e08-94e6-468a-8795-0673b59f77e2/registry-server/0.log"
May 28 19:21:30.672077 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:30.672047    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-chbk2_88c8a299-7ea2-4732-9273-6bc9e8379703/manager/0.log"
May 28 19:21:32.130154 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.130126    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_19bef3d1-57ed-4168-a898-a9c9701e9f97/alertmanager/0.log"
May 28 19:21:32.162832 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.162809    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_19bef3d1-57ed-4168-a898-a9c9701e9f97/config-reloader/0.log"
May 28 19:21:32.193806 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.193785    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_19bef3d1-57ed-4168-a898-a9c9701e9f97/kube-rbac-proxy-web/0.log"
May 28 19:21:32.217278 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.217216    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_19bef3d1-57ed-4168-a898-a9c9701e9f97/kube-rbac-proxy/0.log"
May 28 19:21:32.235073 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.235052    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_19bef3d1-57ed-4168-a898-a9c9701e9f97/kube-rbac-proxy-metric/0.log"
May 28 19:21:32.254027 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.254004    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_19bef3d1-57ed-4168-a898-a9c9701e9f97/prom-label-proxy/0.log"
May 28 19:21:32.272377 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.272358    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_19bef3d1-57ed-4168-a898-a9c9701e9f97/init-config-reloader/0.log"
May 28 19:21:32.365541 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.365516    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-pb9xs_d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd/kube-state-metrics/0.log"
May 28 19:21:32.385888 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.385863    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-pb9xs_d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd/kube-rbac-proxy-main/0.log"
May 28 19:21:32.412287 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.412243    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-pb9xs_d415d6c4-0bf0-4ece-93fa-852cf9b3c8cd/kube-rbac-proxy-self/0.log"
May 28 19:21:32.581213 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.581186    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cjdv5_e9208269-fa63-4699-a455-c591fdfb0166/node-exporter/0.log"
May 28 19:21:32.597237 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.597213    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cjdv5_e9208269-fa63-4699-a455-c591fdfb0166/kube-rbac-proxy/0.log"
May 28 19:21:32.616299 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.616278    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cjdv5_e9208269-fa63-4699-a455-c591fdfb0166/init-textfile/0.log"
May 28 19:21:32.698811 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.698790    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ffjks_517c1c75-b4da-42d5-9166-3e43ff083499/kube-rbac-proxy-main/0.log"
May 28 19:21:32.715796 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.715777    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ffjks_517c1c75-b4da-42d5-9166-3e43ff083499/kube-rbac-proxy-self/0.log"
May 28 19:21:32.732844 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.732825    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-ffjks_517c1c75-b4da-42d5-9166-3e43ff083499/openshift-state-metrics/0.log"
May 28 19:21:32.909141 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.909109    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-w9vqr_010fe337-8c2a-4742-b454-b02db9a81349/prometheus-operator/0.log"
May 28 19:21:32.933220 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:32.933191    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-w9vqr_010fe337-8c2a-4742-b454-b02db9a81349/kube-rbac-proxy/0.log"
May 28 19:21:33.038232 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:33.038202    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57fc9f6dcf-krbhf_f6cf9a92-4f1d-4d08-bd93-b8205def7461/thanos-query/0.log"
May 28 19:21:33.055249 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:33.055221    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57fc9f6dcf-krbhf_f6cf9a92-4f1d-4d08-bd93-b8205def7461/kube-rbac-proxy-web/0.log"
May 28 19:21:33.076297 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:33.076271    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57fc9f6dcf-krbhf_f6cf9a92-4f1d-4d08-bd93-b8205def7461/kube-rbac-proxy/0.log"
May 28 19:21:33.092342 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:33.092316    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57fc9f6dcf-krbhf_f6cf9a92-4f1d-4d08-bd93-b8205def7461/prom-label-proxy/0.log"
May 28 19:21:33.109873 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:33.109851    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57fc9f6dcf-krbhf_f6cf9a92-4f1d-4d08-bd93-b8205def7461/kube-rbac-proxy-rules/0.log"
May 28 19:21:33.126647 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:33.126597    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57fc9f6dcf-krbhf_f6cf9a92-4f1d-4d08-bd93-b8205def7461/kube-rbac-proxy-metrics/0.log"
May 28 19:21:34.702822 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.702786    2572 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"]
May 28 19:21:34.703424 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.703406    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11abe16f-9e39-46e7-82c4-c7f8704e6187" containerName="cleanup"
May 28 19:21:34.703513 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.703427    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="11abe16f-9e39-46e7-82c4-c7f8704e6187" containerName="cleanup"
May 28 19:21:34.703584 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.703535    2572 memory_manager.go:356] "RemoveStaleState removing state" podUID="11abe16f-9e39-46e7-82c4-c7f8704e6187" containerName="cleanup"
May 28 19:21:34.705993 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.705974    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.708085 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.708063    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6z8d\"/\"kube-root-ca.crt\""
May 28 19:21:34.708191 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.708070    2572 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r6z8d\"/\"default-dockercfg-hbxd5\""
May 28 19:21:34.708645 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.708627    2572 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6z8d\"/\"openshift-service-ca.crt\""
May 28 19:21:34.716556 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.716535    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"]
May 28 19:21:34.863822 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.863791    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-sys\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.863822 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.863822    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwxkz\" (UniqueName: \"kubernetes.io/projected/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-kube-api-access-pwxkz\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.864042 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.863853    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-lib-modules\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.864042 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.863949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-proc\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.864042 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.864001    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-podres\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.964729 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.964630    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-proc\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.964729 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.964722    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-podres\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.964913 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.964764    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-proc\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.964913 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.964815    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-sys\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.964913 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.964835    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwxkz\" (UniqueName: \"kubernetes.io/projected/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-kube-api-access-pwxkz\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.964913 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.964877    2572 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-lib-modules\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.964913 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.964892    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-sys\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.964913 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.964889    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-podres\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.965106 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.965001    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-lib-modules\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:34.973741 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:34.973715    2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwxkz\" (UniqueName: \"kubernetes.io/projected/e1804118-9b0e-4c34-8cf8-f539cbd3b6d7-kube-api-access-pwxkz\") pod \"perf-node-gather-daemonset-h5z4k\" (UID: \"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7\") " pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:35.016452 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:35.016422    2572 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:35.153678 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:35.153652    2572 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"]
May 28 19:21:35.154633 ip-10-0-134-108 kubenswrapper[2572]: W0528 19:21:35.154601    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode1804118_9b0e_4c34_8cf8_f539cbd3b6d7.slice/crio-6d5a54c67c66e27b08c44f0a1f3bc8de1f8eb4ad5a11b5424dd2645261b5ba8e WatchSource:0}: Error finding container 6d5a54c67c66e27b08c44f0a1f3bc8de1f8eb4ad5a11b5424dd2645261b5ba8e: Status 404 returned error can't find the container with id 6d5a54c67c66e27b08c44f0a1f3bc8de1f8eb4ad5a11b5424dd2645261b5ba8e
May 28 19:21:35.156307 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:35.156289    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 19:21:35.297116 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:35.297044    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59566b6447-mcjj6_b3420429-889b-4096-abd4-551130eba093/console/0.log"
May 28 19:21:35.544818 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:35.544778    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k" event={"ID":"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7","Type":"ContainerStarted","Data":"0b656a3b6f3a06819e0abfc96ec03deda9fd0d542fcdfa6459ef0d0fc01df181"}
May 28 19:21:35.544818 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:35.544818    2572 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k" event={"ID":"e1804118-9b0e-4c34-8cf8-f539cbd3b6d7","Type":"ContainerStarted","Data":"6d5a54c67c66e27b08c44f0a1f3bc8de1f8eb4ad5a11b5424dd2645261b5ba8e"}
May 28 19:21:35.545057 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:35.544831    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:35.568485 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:35.568428    2572 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k" podStartSLOduration=1.568415444 podStartE2EDuration="1.568415444s" podCreationTimestamp="2026-05-28 19:21:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:21:35.565507218 +0000 UTC m=+2140.125282207" watchObservedRunningTime="2026-05-28 19:21:35.568415444 +0000 UTC m=+2140.128190411"
May 28 19:21:35.826340 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:35.826256    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-wdxb5_4bb4764a-9cd4-4fd5-a6bb-5a84ae973eba/volume-data-source-validator/0.log"
May 28 19:21:36.682131 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:36.682104    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4gpqv_691e0268-af9e-4a0e-a0e3-59ecd26fa764/dns/0.log"
May 28 19:21:36.709527 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:36.709503    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4gpqv_691e0268-af9e-4a0e-a0e3-59ecd26fa764/kube-rbac-proxy/0.log"
May 28 19:21:36.813678 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:36.813651    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6lnc4_f74161a4-02e9-4d30-869f-f53d4767c576/dns-node-resolver/0.log"
May 28 19:21:37.371030 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:37.370996    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z5b94_2a13d797-b325-407d-a167-b39dbe3b2857/node-ca/0.log"
May 28 19:21:38.114461 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:38.114431    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8s5f9g_c1f8f2e1-821c-499d-a23c-f30c27d3f9c5/istio-proxy/0.log"
May 28 19:21:38.312865 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:38.312837    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-lh8gt_265ebe3f-7412-4de0-ae2d-e5c35d45e5cd/istio-proxy/0.log"
May 28 19:21:38.389842 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:38.389762    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bf65b588-4dn44_d7c2a0b3-a9e0-4fca-8859-68305375a968/router/0.log"
May 28 19:21:38.921038 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:38.921011    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fkrb7_f7a086b4-c593-4f6f-ae62-d04002fce0d3/serve-healthcheck-canary/0.log"
May 28 19:21:39.557956 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:39.557918    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5t9b_7835ab43-4329-4f10-be1d-a9201e8e232f/kube-rbac-proxy/0.log"
May 28 19:21:39.576997 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:39.576969    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5t9b_7835ab43-4329-4f10-be1d-a9201e8e232f/exporter/0.log"
May 28 19:21:39.595320 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:39.595300    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c5t9b_7835ab43-4329-4f10-be1d-a9201e8e232f/extractor/0.log"
May 28 19:21:41.559282 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:41.559253    2572 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r6z8d/perf-node-gather-daemonset-h5z4k"
May 28 19:21:41.572703 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:41.572676    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666580-skwkl_48657b7a-f9cf-4eda-af70-41654327aaba/cleanup/0.log"
May 28 19:21:41.598901 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:41.598881    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666595-sbvf2_11abe16f-9e39-46e7-82c4-c7f8704e6187/cleanup/0.log"
May 28 19:21:41.667813 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:41.667784    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cb7848758-hvrqs_bb6b98e0-77e5-4fd5-9688-320b578a1ebb/manager/0.log"
May 28 19:21:41.854562 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:41.854462    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75cc899db8-f8kwm_fd4a1edc-9ba7-4332-a08b-a350d37ae7bb/manager/0.log"
May 28 19:21:43.090008 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:43.089974    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67dcd5d75d-scl2t_fda05b17-f8e9-4479-8a6f-77949063108c/manager/0.log"
May 28 19:21:43.115532 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:43.115509    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-wq9n7_8a23f292-9d15-4ec4-90d9-73cfa37587ce/openshift-lws-operator/0.log"
May 28 19:21:49.296508 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:49.296482    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpd7z_7cedd45a-9c5b-4d26-b004-7096a2103638/kube-multus-additional-cni-plugins/0.log"
May 28 19:21:49.317592 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:49.317559    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpd7z_7cedd45a-9c5b-4d26-b004-7096a2103638/egress-router-binary-copy/0.log"
May 28 19:21:49.335654 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:49.335634    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpd7z_7cedd45a-9c5b-4d26-b004-7096a2103638/cni-plugins/0.log"
May 28 19:21:49.355590 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:49.355570    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpd7z_7cedd45a-9c5b-4d26-b004-7096a2103638/bond-cni-plugin/0.log"
May 28 19:21:49.382096 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:49.382080    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpd7z_7cedd45a-9c5b-4d26-b004-7096a2103638/routeoverride-cni/0.log"
May 28 19:21:49.403161 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:49.403142    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpd7z_7cedd45a-9c5b-4d26-b004-7096a2103638/whereabouts-cni-bincopy/0.log"
May 28 19:21:49.423912 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:49.423894    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kpd7z_7cedd45a-9c5b-4d26-b004-7096a2103638/whereabouts-cni/0.log"
May 28 19:21:49.457396 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:49.457369    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d8s9c_9a1e17f8-bf36-455f-b124-a3beefa6850e/kube-multus/0.log"
May 28 19:21:49.604835 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:49.604814    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-shplj_a7cc5970-0522-44ea-b02e-1ff310c0793c/network-metrics-daemon/0.log"
May 28 19:21:49.621545 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:49.621523    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-shplj_a7cc5970-0522-44ea-b02e-1ff310c0793c/kube-rbac-proxy/0.log"
May 28 19:21:50.683859 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:50.683831    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-controller/0.log"
May 28 19:21:50.698838 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:50.698815    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/0.log"
May 28 19:21:50.710475 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:50.710453    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovn-acl-logging/1.log"
May 28 19:21:50.728261 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:50.728240    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/kube-rbac-proxy-node/0.log"
May 28 19:21:50.746577 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:50.746558    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/kube-rbac-proxy-ovn-metrics/0.log"
May 28 19:21:50.763061 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:50.763039    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/northd/0.log"
May 28 19:21:50.779758 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:50.779735    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/nbdb/0.log"
May 28 19:21:50.796439 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:50.796352    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/sbdb/0.log"
May 28 19:21:50.890099 ip-10-0-134-108 kubenswrapper[2572]: I0528 19:21:50.890064    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-drfnc_e4f84636-68e1-4725-8733-3b652bc4b925/ovnkube-controller/0.log"