May 20 20:48:46.930801 ip-10-0-142-248 systemd[1]: Starting Kubernetes Kubelet...
May 20 20:48:47.422734 ip-10-0-142-248 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:48:47.422734 ip-10-0-142-248 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 20 20:48:47.422734 ip-10-0-142-248 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:48:47.422734 ip-10-0-142-248 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 20 20:48:47.422734 ip-10-0-142-248 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:48:47.424705 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.424621    2556 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 20 20:48:47.428232 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428217    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:48:47.428232 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428233    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428237    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428240    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428243    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428246    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428249    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428252    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428256    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428259    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428261    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428269    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428272    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428275    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428279    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428283    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428286    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428289    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428291    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428294    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:48:47.428298 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428296    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428299    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428302    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428304    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428307    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428310    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428313    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428315    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428318    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428320    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428323    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428326    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428328    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428331    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428333    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428341    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428344    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428347    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428349    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428352    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:48:47.428772 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428354    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428357    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428360    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428362    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428365    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428367    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428370    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428372    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428375    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428377    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428380    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428382    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428385    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428388    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428391    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428394    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428397    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428400    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428402    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:48:47.429257 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428407    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428410    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428413    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428416    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428419    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428422    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428424    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428427    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428441    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428448    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428451    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428454    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428457    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428460    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428463    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428465    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428468    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428471    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428473    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428476    2556 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428478    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:48:47.429739 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428481    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428483    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428486    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428489    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428491    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428494    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428916    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428922    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428925    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428928    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428930    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428933    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428935    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428938    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428941    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428944    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428946    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428949    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428951    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:48:47.430249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428954    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428964    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428968    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428970    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428973    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428975    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428978    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428980    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428983    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428985    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428988    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428990    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428993    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428995    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.428998    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429000    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429003    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429006    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429008    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:48:47.430717 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429011    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429014    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429016    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429019    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429021    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429024    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429026    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429029    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429031    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429034    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429036    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429038    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429041    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429044    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429046    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429055    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429058    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429060    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429063    2556 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429065    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:48:47.431191 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429068    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429070    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429073    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429075    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429077    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429080    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429082    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429085    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429088    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429090    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429093    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429095    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429098    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429101    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429103    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429106    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429109    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429112    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429114    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429117    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:48:47.431759 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429119    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429122    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429127    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429130    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429133    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429136    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429138    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429141    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429149    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429152    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429154    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429157    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429159    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.429162    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430406    2556 flags.go:64] FLAG: --address="0.0.0.0"
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430416    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430425    2556 flags.go:64] FLAG: --anonymous-auth="true"
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430441    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430446    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430449    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430454    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 20 20:48:47.432237 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430459    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430462    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430464    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430468    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430471    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430474    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430477    2556 flags.go:64] FLAG: --cgroup-root=""
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430480    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430483    2556 flags.go:64] FLAG: --client-ca-file=""
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430486    2556 flags.go:64] FLAG: --cloud-config=""
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430489    2556 flags.go:64] FLAG: --cloud-provider="external"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430491    2556 flags.go:64] FLAG: --cluster-dns="[]"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430498    2556 flags.go:64] FLAG: --cluster-domain=""
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430501    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430504    2556 flags.go:64] FLAG: --config-dir=""
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430507    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430510    2556 flags.go:64] FLAG: --container-log-max-files="5"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430514    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430517    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430520    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430529    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430532    2556 flags.go:64] FLAG: --contention-profiling="false"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430536    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430539    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430542    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
May 20 20:48:47.432770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430545    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430549    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430552    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430555    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430557    2556 flags.go:64] FLAG: --enable-load-reader="false"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430560    2556 flags.go:64] FLAG: --enable-server="true"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430563    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430569    2556 flags.go:64] FLAG: --event-burst="100"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430572    2556 flags.go:64] FLAG: --event-qps="50"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430575    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430578    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430581    2556 flags.go:64] FLAG: --eviction-hard=""
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430584    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430587    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430590    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430593    2556 flags.go:64] FLAG: --eviction-soft=""
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430596    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430598    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430601    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430604    2556 flags.go:64] FLAG: --experimental-mounter-path=""
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430607    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430609    2556 flags.go:64] FLAG: --fail-swap-on="true"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430612    2556 flags.go:64] FLAG: --feature-gates=""
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430616    2556 flags.go:64] FLAG: --file-check-frequency="20s"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430619    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 20 20:48:47.433395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430622    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430625    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430628    2556 flags.go:64] FLAG: --healthz-port="10248"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430638    2556 flags.go:64] FLAG: --help="false"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430641    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-142-248.ec2.internal"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430644    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430647    2556 flags.go:64] FLAG: --http-check-frequency="20s"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430650    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430653    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430657    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430660    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430662    2556 flags.go:64] FLAG: --image-service-endpoint=""
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430665    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430668    2556 flags.go:64] FLAG: --kube-api-burst="100"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430671    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430674    2556 flags.go:64] FLAG: --kube-api-qps="50"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430676    2556 flags.go:64] FLAG: --kube-reserved=""
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430685    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430687    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430690    2556 flags.go:64] FLAG: --kubelet-cgroups=""
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430693    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430696    2556 flags.go:64] FLAG: --lock-file=""
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430698    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430701    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
May 20 20:48:47.434006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430704    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430709    2556 flags.go:64] FLAG: --log-json-split-stream="false"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430712    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430715    2556 flags.go:64] FLAG: --log-text-split-stream="false"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430717    2556 flags.go:64] FLAG: --logging-format="text"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430720    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430724    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430726    2556 flags.go:64] FLAG: --manifest-url=""
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430730    2556 flags.go:64] FLAG: --manifest-url-header=""
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430738    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430741    2556 flags.go:64] FLAG: --max-open-files="1000000"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430745    2556 flags.go:64] FLAG: --max-pods="110"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430754    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430757    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430760    2556 flags.go:64] FLAG: --memory-manager-policy="None"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430763    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430766    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430769    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430772    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430779    2556 flags.go:64] FLAG: --node-status-max-images="50"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430782    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430785    2556 flags.go:64] FLAG: --oom-score-adj="-999"
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430788    2556 flags.go:64] FLAG: --pod-cidr=""
May 20 20:48:47.434626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430791    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430796    2556 flags.go:64] FLAG: --pod-manifest-path=""
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430799    2556 flags.go:64] FLAG: --pod-max-pids="-1"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430803    2556 flags.go:64] FLAG: --pods-per-core="0"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430806    2556 flags.go:64] FLAG: --port="10250"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430809    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430811    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ddcd8d4b57390ff9"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430815    2556 flags.go:64] FLAG: --qos-reserved=""
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430818    2556 flags.go:64] FLAG: --read-only-port="10255"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430820    2556 flags.go:64] FLAG: --register-node="true"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430824    2556 flags.go:64] FLAG: --register-schedulable="true"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430826    2556 flags.go:64] FLAG: --register-with-taints=""
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430830    2556 flags.go:64] FLAG: --registry-burst="10"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430833    2556 flags.go:64] FLAG: --registry-qps="5"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430835    2556 flags.go:64] FLAG: --reserved-cpus=""
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430838    2556 flags.go:64] FLAG: --reserved-memory=""
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430842    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430845    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430848    2556 flags.go:64] FLAG: --rotate-certificates="false"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430850    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430853    2556 flags.go:64] FLAG: --runonce="false"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430856    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430865    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430868    2556 flags.go:64] FLAG: --seccomp-default="false"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430871    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430874    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 20 20:48:47.435180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430877    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430880    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430883    2556 flags.go:64] FLAG: --storage-driver-password="root"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430886    2556 flags.go:64] FLAG: --storage-driver-secure="false"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430889    2556 flags.go:64] FLAG: --storage-driver-table="stats"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430891    2556 flags.go:64] FLAG: --storage-driver-user="root"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430894    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430897    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430901    2556 flags.go:64] FLAG: --system-cgroups=""
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430903    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430908    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430911    2556 flags.go:64] FLAG: --tls-cert-file=""
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430914    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430921    2556 flags.go:64] FLAG: --tls-min-version=""
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430924    2556 flags.go:64] FLAG: --tls-private-key-file=""
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430927    2556 flags.go:64] FLAG: --topology-manager-policy="none"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430929    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430932    2556 flags.go:64] FLAG: --topology-manager-scope="container"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430935    2556 flags.go:64] FLAG: --v="2"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430939    2556 flags.go:64] FLAG: --version="false"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430943    2556 flags.go:64] FLAG: --vmodule=""
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430947    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.430950    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431086    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:48:47.435852 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431090    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431094    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431096    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431101    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431104    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431112    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431115    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431117    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431120    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431122    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431125    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431127    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431130    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431132    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431135    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431138    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431140    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431143    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431145    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431148    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:48:47.436467 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431150    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431153    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431155    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431158    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431160    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431163    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431165    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431168    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431170    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431173    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431175    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431178    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431180    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431183    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431185    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431190    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431192    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431195    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431204    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431207    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:48:47.436973 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431210    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431213    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431215    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431218    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431221    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431223    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431228    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431231    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431233    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431236    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431238    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431240    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431243    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431245    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431248    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431250    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431253    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431255    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431258    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:48:47.437472 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431260    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431263    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431265    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431268    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431271    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431275    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431278    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431280    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431285    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431287    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431290    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431292    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431300    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431303    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431305    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431308    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431312    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431315    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431318    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:48:47.437951 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431323    2556 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:48:47.438421 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431326    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:48:47.438421 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431329    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:48:47.438421 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431332    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:48:47.438421 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431334    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:48:47.438421 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431337    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:48:47.438421 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.431348    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:48:47.438421 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.432045    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:48:47.440391 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.440277    2556 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 20 20:48:47.440391 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.440390    2556 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440457    2556 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440463    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440467    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440470    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440473    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440476    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440479    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440482    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440484    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440487    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440490    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440493    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440496    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440498    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440502    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440507    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440510    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440512    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440515    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:48:47.440548 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440518    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440521    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440524    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440526    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440529    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440532    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440537    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440540    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440543    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440545    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440548    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440552    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440557    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440560    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440564    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440567    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440570    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440572    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440575    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:48:47.441039 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440578    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440580    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440583    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440585    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440588    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440590    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440593    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440595    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440598    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440600    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440603    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440606    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440609    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440612    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440614    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440618    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440620    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440623    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440625    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440628    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:48:47.441553 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440630    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440633    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440635    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440638    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440641    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440643    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440645    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440648    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440651    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440654    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440656    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440659    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440662    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440665    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440667    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440670    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440672    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440674    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440683    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440686    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:48:47.442040 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440688    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440691    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440693    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440696    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440699    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440702    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440704    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440707    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.440713    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440806    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440810    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440814    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440817    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440820    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440823    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440826    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:48:47.442551 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440828    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440831    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440834    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440837    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440840    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440842    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440845    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440847    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440850    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440853    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440855    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440857    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440860    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440862    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440865    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440874    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440876    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440879    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440881    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440884    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:48:47.442953 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440887    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440890    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440892    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440895    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440898    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440900    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440903    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440905    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440908    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440910    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440913    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440915    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440918    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440920    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440923    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440925    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440928    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440931    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440933    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440936    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:48:47.443454 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440939    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440941    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440943    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440946    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440948    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440952    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440955    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440958    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440967    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440971    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440973    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440976    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440979    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440981    2556 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440984    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440986    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440989    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440992    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440994    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:48:47.443933 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440996    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.440999    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441001    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441004    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441006    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441009    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441011    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441014    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441016    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441019    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441021    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441024    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441026    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441029    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441031    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441034    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441036    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441039    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441041    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:48:47.444402 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:47.441044    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:48:47.444897 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.441049    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:48:47.444897 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.441792    2556 server.go:962] "Client rotation is on, will bootstrap in background"
May 20 20:48:47.445823 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.445809    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 20 20:48:47.446710 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.446698    2556 server.go:1019] "Starting client certificate rotation"
May 20 20:48:47.446815 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.446799    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 20:48:47.446849 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.446836    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 20:48:47.473119 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.473101    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 20:48:47.474922 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.474907    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 20:48:47.486868 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.486849    2556 log.go:25] "Validated CRI v1 runtime API"
May 20 20:48:47.493867 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.493851    2556 log.go:25] "Validated CRI v1 image API"
May 20 20:48:47.495202 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.495181    2556 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 20 20:48:47.503729 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.503703    2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d61184cf-1890-4cd2-a980-bc39d73101a1:/dev/nvme0n1p3 e2df1b76-5b68-4fcd-a3ea-48fb05d4824f:/dev/nvme0n1p4]
May 20 20:48:47.503814 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.503728    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 20 20:48:47.508932 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.508913    2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 20:48:47.509784 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.509673    2556 manager.go:217] Machine: {Timestamp:2026-05-20 20:48:47.509175218 +0000 UTC m=+0.438771948 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093173 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea786f006caf16b5f36b2db462227 SystemUUID:ec2ea786-f006-caf1-6b5f-36b2db462227 BootID:61a80475-10bb-4623-9019-01de293cfb8f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:03:50:0c:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:03:50:0c:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:07:b7:31:02:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 20 20:48:47.510315 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.510301    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 20 20:48:47.510468 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.510452    2556 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 20 20:48:47.512502 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.512479    2556 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 20 20:48:47.512635 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.512505    2556 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-248.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 20 20:48:47.512680 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.512644    2556 topology_manager.go:138] "Creating topology manager with none policy"
May 20 20:48:47.512680 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.512652    2556 container_manager_linux.go:306] "Creating device plugin manager"
May 20 20:48:47.512680 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.512659    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 20:48:47.512680 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.512676    2556 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 20:48:47.514539 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.514527    2556 state_mem.go:36] "Initialized new in-memory state store"
May 20 20:48:47.514653 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.514644    2556 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 20 20:48:47.516928 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.516919    2556 kubelet.go:491] "Attempting to sync node with API server"
May 20 20:48:47.516969 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.516931    2556 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 20 20:48:47.516969 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.516943    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 20 20:48:47.516969 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.516952    2556 kubelet.go:397] "Adding apiserver pod source"
May 20 20:48:47.516969 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.516960    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 20 20:48:47.518186 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.518172    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 20:48:47.518234 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.518192    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 20:48:47.521610 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.521592    2556 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 20 20:48:47.523328 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.523313    2556 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 20 20:48:47.524118 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524104    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 20 20:48:47.524167 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524126    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 20 20:48:47.524167 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524134    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 20 20:48:47.524167 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524139    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 20 20:48:47.524167 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524147    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 20 20:48:47.524167 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524153    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 20 20:48:47.524167 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524159    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 20 20:48:47.524167 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524165    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 20 20:48:47.524357 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524173    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 20 20:48:47.524357 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524179    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 20 20:48:47.524357 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524197    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 20 20:48:47.524504 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.524491    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 20 20:48:47.525987 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.525975    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 20 20:48:47.526019 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.525991    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 20 20:48:47.528632 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.528604    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-clvbq"
May 20 20:48:47.529477 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.529460    2556 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 20 20:48:47.529477 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.529447    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-248.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 20 20:48:47.529624 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.529445    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 20 20:48:47.529624 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.529482    2556 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-248.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 20 20:48:47.529624 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.529508    2556 server.go:1295] "Started kubelet"
May 20 20:48:47.529624 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.529565    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 20 20:48:47.529772 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.529663    2556 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 20 20:48:47.529772 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.529713    2556 server_v1.go:47] "podresources" method="list" useActivePods=true
May 20 20:48:47.530359 ip-10-0-142-248 systemd[1]: Started Kubernetes Kubelet.
May 20 20:48:47.531001 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.530964    2556 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 20 20:48:47.531867 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.531852    2556 server.go:317] "Adding debug handlers to kubelet server"
May 20 20:48:47.537967 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.537950    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-clvbq"
May 20 20:48:47.538333 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.537416    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-248.ec2.internal.18b1612240a63e35  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-248.ec2.internal,UID:ip-10-0-142-248.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-248.ec2.internal,},FirstTimestamp:2026-05-20 20:48:47.529475637 +0000 UTC m=+0.459072368,LastTimestamp:2026-05-20 20:48:47.529475637 +0000 UTC m=+0.459072368,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-248.ec2.internal,}"
May 20 20:48:47.538333 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.538277    2556 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 20 20:48:47.538522 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.538423    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 20 20:48:47.538975 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.538955    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 20 20:48:47.539210 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.539192    2556 volume_manager.go:295] "The desired_state_of_world populator starts"
May 20 20:48:47.539270 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.539212    2556 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 20 20:48:47.539487 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.539466    2556 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 20 20:48:47.539574 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.539547    2556 reconstruct.go:97] "Volume reconstruction finished"
May 20 20:48:47.539574 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.539557    2556 reconciler.go:26] "Reconciler: start to sync state"
May 20 20:48:47.539729 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.539715    2556 factory.go:55] Registering systemd factory
May 20 20:48:47.539789 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.539731    2556 factory.go:223] Registration of the systemd container factory successfully
May 20 20:48:47.540115 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.540073    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:47.540260 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.540242    2556 factory.go:153] Registering CRI-O factory
May 20 20:48:47.540333 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.540266    2556 factory.go:223] Registration of the crio container factory successfully
May 20 20:48:47.540386 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.540340    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 20 20:48:47.540386 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.540359    2556 factory.go:103] Registering Raw factory
May 20 20:48:47.540386 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.540379    2556 manager.go:1196] Started watching for new ooms in manager
May 20 20:48:47.540988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.540971    2556 manager.go:319] Starting recovery of all containers
May 20 20:48:47.545804 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.545787    2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:48:47.550087 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.550041    2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 20 20:48:47.550506 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.550478    2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-248.ec2.internal\" not found" node="ip-10-0-142-248.ec2.internal"
May 20 20:48:47.552645 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.552627    2556 manager.go:324] Recovery completed
May 20 20:48:47.557314 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.557301    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:47.559103 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.559090    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:47.559162 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.559116    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:47.559162 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.559127    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:47.559623 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.559610    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 20 20:48:47.559623 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.559621    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 20 20:48:47.559722 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.559636    2556 state_mem.go:36] "Initialized new in-memory state store"
May 20 20:48:47.561927 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.561915    2556 policy_none.go:49] "None policy: Start"
May 20 20:48:47.561978 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.561930    2556 memory_manager.go:186] "Starting memorymanager" policy="None"
May 20 20:48:47.561978 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.561939    2556 state_mem.go:35] "Initializing new in-memory state store"
May 20 20:48:47.596007 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.595994    2556 manager.go:341] "Starting Device Plugin manager"
May 20 20:48:47.611276 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.596046    2556 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 20 20:48:47.611276 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.596060    2556 server.go:85] "Starting device plugin registration server"
May 20 20:48:47.611276 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.596248    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
May 20 20:48:47.611276 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.596257    2556 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 20 20:48:47.611276 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.596362    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 20 20:48:47.611276 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.596450    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 20 20:48:47.611276 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.596458    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 20 20:48:47.611276 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.597460    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 20 20:48:47.611276 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.597501    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:47.669448 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.669410    2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 20 20:48:47.669963 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.669952    2556 status_manager.go:230] "Starting to sync pod status with apiserver"
May 20 20:48:47.670027 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.669977    2556 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 20 20:48:47.670027 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.669986    2556 kubelet.go:2451] "Starting kubelet main sync loop"
May 20 20:48:47.670119 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.670056    2556 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 20 20:48:47.673229 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.673177    2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:48:47.697015 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.696996    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:47.697839 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.697822    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:47.697909 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.697853    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:47.697909 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.697863    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:47.697909 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.697893    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-248.ec2.internal"
May 20 20:48:47.706134 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.706121    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-248.ec2.internal"
May 20 20:48:47.706183 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.706139    2556 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-248.ec2.internal\": node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:47.721416 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.721396    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:47.770147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.770117    2556 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-248.ec2.internal"]
May 20 20:48:47.770208 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.770202    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:47.770986 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.770972    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:47.771036 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.771001    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:47.771036 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.771015    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:47.772293 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.772280    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:47.772872 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.772857    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:47.772932 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.772883    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:47.772932 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.772892    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:47.772993 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.772959    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal"
May 20 20:48:47.772993 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.772984    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:47.773580 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.773566    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:47.773639 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.773592    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:47.773639 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.773603    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:47.774071 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.774056    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-248.ec2.internal"
May 20 20:48:47.774127 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.774078    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:48:47.774663 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.774648    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:48:47.774745 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.774674    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:48:47.774745 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.774687    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeHasSufficientPID"
May 20 20:48:47.789969 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.789950    2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-248.ec2.internal\" not found" node="ip-10-0-142-248.ec2.internal"
May 20 20:48:47.793478 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.793451    2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-248.ec2.internal\" not found" node="ip-10-0-142-248.ec2.internal"
May 20 20:48:47.821509 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.821484    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:47.841546 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.841525    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/34ffa07bae13a4659fa95a14729022c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal\" (UID: \"34ffa07bae13a4659fa95a14729022c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal"
May 20 20:48:47.841620 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.841550    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ffa07bae13a4659fa95a14729022c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal\" (UID: \"34ffa07bae13a4659fa95a14729022c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal"
May 20 20:48:47.841620 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.841568    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/720b70deb7ab5afafdb209777059a35b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-248.ec2.internal\" (UID: \"720b70deb7ab5afafdb209777059a35b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-248.ec2.internal"
May 20 20:48:47.921896 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:47.921865    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:47.942240 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.942190    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ffa07bae13a4659fa95a14729022c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal\" (UID: \"34ffa07bae13a4659fa95a14729022c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal"
May 20 20:48:47.942240 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.942225    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ffa07bae13a4659fa95a14729022c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal\" (UID: \"34ffa07bae13a4659fa95a14729022c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal"
May 20 20:48:47.942328 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.942236    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/720b70deb7ab5afafdb209777059a35b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-248.ec2.internal\" (UID: \"720b70deb7ab5afafdb209777059a35b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-248.ec2.internal"
May 20 20:48:47.942328 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.942271    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/720b70deb7ab5afafdb209777059a35b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-248.ec2.internal\" (UID: \"720b70deb7ab5afafdb209777059a35b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-248.ec2.internal"
May 20 20:48:47.942328 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.942288    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/34ffa07bae13a4659fa95a14729022c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal\" (UID: \"34ffa07bae13a4659fa95a14729022c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal"
May 20 20:48:47.942328 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:47.942319    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/34ffa07bae13a4659fa95a14729022c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal\" (UID: \"34ffa07bae13a4659fa95a14729022c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal"
May 20 20:48:48.022576 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:48.022538    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:48.093008 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.092975    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal"
May 20 20:48:48.095733 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.095714    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-248.ec2.internal"
May 20 20:48:48.123293 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:48.123267    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:48.223839 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:48.223776    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:48.324270 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:48.324240    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:48.424758 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:48.424740    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:48.447178 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.447152    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 20 20:48:48.447319 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.447302    2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 20:48:48.447385 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.447321    2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 20:48:48.525723 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:48.525694    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:48.539181 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.539160    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 20 20:48:48.539818 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.539790    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 20:43:47 +0000 UTC" deadline="2027-11-23 02:19:49.05475785 +0000 UTC"
May 20 20:48:48.539910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.539818    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13229h31m0.514941772s"
May 20 20:48:48.551636 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.551618    2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 20:48:48.576591 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.576564    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjp7k"
May 20 20:48:48.584196 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.584179    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjp7k"
May 20 20:48:48.613673 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:48.613489    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ffa07bae13a4659fa95a14729022c1.slice/crio-d6b69a20eeb89ffa2f7413636213c789da604a10895f1e6862da1a395c490f61 WatchSource:0}: Error finding container d6b69a20eeb89ffa2f7413636213c789da604a10895f1e6862da1a395c490f61: Status 404 returned error can't find the container with id d6b69a20eeb89ffa2f7413636213c789da604a10895f1e6862da1a395c490f61
May 20 20:48:48.613897 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:48.613880    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720b70deb7ab5afafdb209777059a35b.slice/crio-f0efbf13a0b0784ff96a06039274971f36e616943331030c3910321be8a0994e WatchSource:0}: Error finding container f0efbf13a0b0784ff96a06039274971f36e616943331030c3910321be8a0994e: Status 404 returned error can't find the container with id f0efbf13a0b0784ff96a06039274971f36e616943331030c3910321be8a0994e
May 20 20:48:48.617682 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.617665    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:48:48.626052 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:48.626035    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:48.672548 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.672504    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-248.ec2.internal" event={"ID":"720b70deb7ab5afafdb209777059a35b","Type":"ContainerStarted","Data":"f0efbf13a0b0784ff96a06039274971f36e616943331030c3910321be8a0994e"}
May 20 20:48:48.673386 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.673367    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal" event={"ID":"34ffa07bae13a4659fa95a14729022c1","Type":"ContainerStarted","Data":"d6b69a20eeb89ffa2f7413636213c789da604a10895f1e6862da1a395c490f61"}
May 20 20:48:48.726545 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:48.726517    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:48.767821 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:48.767769    2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:48:48.827014 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:48.826988    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:48.927509 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:48.927469    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-248.ec2.internal\" not found"
May 20 20:48:49.001488 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.001468    2556 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:48:49.040029 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.039953    2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal"
May 20 20:48:49.052658 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.052627    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 20:48:49.053545 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.053520    2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-248.ec2.internal"
May 20 20:48:49.060832 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.060809    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 20:48:49.457949 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.457869    2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:48:49.517954 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.517933    2556 apiserver.go:52] "Watching apiserver"
May 20 20:48:49.524786 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.524765    2556 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 20 20:48:49.526898 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.526875    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-qs7qh","openshift-dns/node-resolver-xmllx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal","openshift-multus/multus-additional-cni-plugins-h629x","openshift-network-operator/iptables-alerter-r7lrv","kube-system/konnectivity-agent-hngnv","kube-system/kube-apiserver-proxy-ip-10-0-142-248.ec2.internal","openshift-image-registry/node-ca-7g48h","openshift-multus/multus-xc75b","openshift-multus/network-metrics-daemon-xmtnp","openshift-network-diagnostics/network-check-target-lzlgx","openshift-ovn-kubernetes/ovnkube-node-dfxdb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"]
May 20 20:48:49.529300 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.529277    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:49.529409 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:49.529366    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:48:49.529503 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.529413    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xmllx"
May 20 20:48:49.530484 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.530462    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.531792 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.531661    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 20 20:48:49.531792 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.531693    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 20 20:48:49.531944 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.531807    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tfp46\""
May 20 20:48:49.532315 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.532270    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 20 20:48:49.532402 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.532354    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 20 20:48:49.532651 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.532635    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 20 20:48:49.532765 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.532739    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r7lrv"
May 20 20:48:49.532873 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.532638    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 20 20:48:49.533179 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.533081    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 20 20:48:49.534002 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.533624    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-66qdt\""
May 20 20:48:49.534992 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.534620    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 20 20:48:49.534992 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.534917    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d6qd8\""
May 20 20:48:49.534992 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.534939    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 20 20:48:49.535168 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.535129    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hngnv"
May 20 20:48:49.535220 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.535195    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 20 20:48:49.536861 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.536841    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7g48h"
May 20 20:48:49.537006 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.536960    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xc75b"
May 20 20:48:49.538118 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.538097    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7w2b9\""
May 20 20:48:49.538196 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.538179    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 20 20:48:49.538260 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.538244    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 20 20:48:49.538626 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.538523    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.539360 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.539335    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 20 20:48:49.539728 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.539685    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:49.539728 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.539718    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 20 20:48:49.539882 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:49.539757    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:48:49.539882 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.539841    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-txvc6\""
May 20 20:48:49.539972 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.539904    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 20 20:48:49.540030 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.540021    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4bdh6\""
May 20 20:48:49.540093 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.540073    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 20 20:48:49.540646 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.540622    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 20 20:48:49.540740 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.540725    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 20 20:48:49.540817 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.540803    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z8szs\""
May 20 20:48:49.541246 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.541189    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.542458 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.542426    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.543783 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.543765    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 20 20:48:49.543783 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.543782    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rwzhj\""
May 20 20:48:49.543967 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.543943    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 20 20:48:49.544038 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.543989    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 20 20:48:49.544038 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.543989    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 20 20:48:49.544137 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.544048    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 20 20:48:49.544341 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.544322    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 20 20:48:49.544617 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.544601    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 20 20:48:49.544617 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.544603    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 20 20:48:49.544762 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.544603    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dnnbd\""
May 20 20:48:49.544762 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.544606    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 20 20:48:49.550660 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550642    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-run-ovn\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.550764 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550667    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-log-socket\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.550764 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550684    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.550764 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550728    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-os-release\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.550925 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550762    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-run-k8s-cni-cncf-io\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.550925 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550799    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-etc-kubernetes\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.550925 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550831    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-var-lib-kubelet\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.550925 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550881    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c8wd\" (UniqueName: \"kubernetes.io/projected/b28595cf-e76f-4d05-90ed-853ca86a467c-kube-api-access-7c8wd\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.550925 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550912    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-sysconfig\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.551169 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550940    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94785fb9-7efd-46ff-b03b-70204f3bfa65-host-slash\") pod \"iptables-alerter-r7lrv\" (UID: \"94785fb9-7efd-46ff-b03b-70204f3bfa65\") " pod="openshift-network-operator/iptables-alerter-r7lrv"
May 20 20:48:49.551169 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550968    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-cni-dir\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.551169 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.550990    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-run-netns\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.551169 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551013    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-ovnkube-script-lib\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.551169 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551037    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-var-lib-kubelet\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.551169 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551061    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-run-multus-certs\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.551169 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551094    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-etc-openvswitch\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.551169 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551111    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-ovnkube-config\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.551169 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551142    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-kubernetes\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551180    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-os-release\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551239    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-cni-binary-copy\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551264    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551285    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-cni-binary-copy\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551337    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-run-netns\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551395    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-daemon-config\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551422    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-sysctl-d\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551483    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-sys\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551510    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551533    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-hostroot\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551557    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-var-lib-openvswitch\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551580    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-kubelet\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.551609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551612    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-systemd-units\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551634    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-run-openvswitch\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551663    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-ovn-node-metrics-cert\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551708    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58dgp\" (UniqueName: \"kubernetes.io/projected/bf8a3989-f2f8-4bb7-a1de-9d400bc27a70-kube-api-access-58dgp\") pod \"node-resolver-xmllx\" (UID: \"bf8a3989-f2f8-4bb7-a1de-9d400bc27a70\") " pod="openshift-dns/node-resolver-xmllx"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551736    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-var-lib-cni-multus\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551756    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-node-log\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551820    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgt76\" (UniqueName: \"kubernetes.io/projected/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-kube-api-access-qgt76\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551854    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-socket-dir-parent\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551869    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551885    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-run\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551899    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-sysctl-conf\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551919    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf8a3989-f2f8-4bb7-a1de-9d400bc27a70-hosts-file\") pod \"node-resolver-xmllx\" (UID: \"bf8a3989-f2f8-4bb7-a1de-9d400bc27a70\") " pod="openshift-dns/node-resolver-xmllx"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551951    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-modprobe-d\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.551976    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97hkz\" (UniqueName: \"kubernetes.io/projected/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-kube-api-access-97hkz\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552017    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-conf-dir\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552047    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.552116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552062    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf8a3989-f2f8-4bb7-a1de-9d400bc27a70-tmp-dir\") pod \"node-resolver-xmllx\" (UID: \"bf8a3989-f2f8-4bb7-a1de-9d400bc27a70\") " pod="openshift-dns/node-resolver-xmllx"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552096    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddwdg\" (UniqueName: \"kubernetes.io/projected/f8322035-26e8-42bd-9269-3ba2a2284d96-kube-api-access-ddwdg\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552114    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-cnibin\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552136    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94785fb9-7efd-46ff-b03b-70204f3bfa65-iptables-alerter-script\") pod \"iptables-alerter-r7lrv\" (UID: \"94785fb9-7efd-46ff-b03b-70204f3bfa65\") " pod="openshift-network-operator/iptables-alerter-r7lrv"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552158    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcvm9\" (UniqueName: \"kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9\") pod \"network-check-target-lzlgx\" (UID: \"e9891820-0bca-47e4-8919-db86ff059d14\") " pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552193    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-cni-netd\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552219    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-system-cni-dir\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552233    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbflc\" (UniqueName: \"kubernetes.io/projected/94785fb9-7efd-46ff-b03b-70204f3bfa65-kube-api-access-gbflc\") pod \"iptables-alerter-r7lrv\" (UID: \"94785fb9-7efd-46ff-b03b-70204f3bfa65\") " pod="openshift-network-operator/iptables-alerter-r7lrv"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552270    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-var-lib-cni-bin\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552302    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-slash\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552328    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-run-systemd\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552354    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-env-overrides\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md4kq\" (UniqueName: \"kubernetes.io/projected/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-kube-api-access-md4kq\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552409    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77d15cbb-b7fe-476a-9281-d65587fc0b99-agent-certs\") pod \"konnectivity-agent-hngnv\" (UID: \"77d15cbb-b7fe-476a-9281-d65587fc0b99\") " pod="kube-system/konnectivity-agent-hngnv"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552484    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-systemd\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.552831 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552510    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-tuned\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.553302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552532    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b28595cf-e76f-4d05-90ed-853ca86a467c-tmp\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.553302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552554    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-system-cni-dir\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.553302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552575    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-cnibin\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.553302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552598    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-cni-bin\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.553302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552638    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-host\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.553302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552667    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77d15cbb-b7fe-476a-9281-d65587fc0b99-konnectivity-ca\") pod \"konnectivity-agent-hngnv\" (UID: \"77d15cbb-b7fe-476a-9281-d65587fc0b99\") " pod="kube-system/konnectivity-agent-hngnv"
May 20 20:48:49.553302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552688    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70a22dd4-17d1-4946-9a36-891f152790aa-host\") pod \"node-ca-7g48h\" (UID: \"70a22dd4-17d1-4946-9a36-891f152790aa\") " pod="openshift-image-registry/node-ca-7g48h"
May 20 20:48:49.553302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552709    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70a22dd4-17d1-4946-9a36-891f152790aa-serviceca\") pod \"node-ca-7g48h\" (UID: \"70a22dd4-17d1-4946-9a36-891f152790aa\") " pod="openshift-image-registry/node-ca-7g48h"
May 20 20:48:49.553302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552754    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps6gd\" (UniqueName: \"kubernetes.io/projected/70a22dd4-17d1-4946-9a36-891f152790aa-kube-api-access-ps6gd\") pod \"node-ca-7g48h\" (UID: \"70a22dd4-17d1-4946-9a36-891f152790aa\") " pod="openshift-image-registry/node-ca-7g48h"
May 20 20:48:49.553302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.552780    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-lib-modules\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.584888 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.584858    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 20:43:48 +0000 UTC" deadline="2028-01-10 03:10:20.607016299 +0000 UTC"
May 20 20:48:49.584977 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.584888    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14382h21m31.022131562s"
May 20 20:48:49.640359 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.640331    2556 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 20 20:48:49.653302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653277    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.653394 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653312    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-cni-binary-copy\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.653394 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653338    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-run-netns\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.653394 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653362    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-daemon-config\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.653394 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653386    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-sysctl-d\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653409    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-sys\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653450    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653462    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-run-netns\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653463    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653473    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-hostroot\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653508    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-hostroot\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653511    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-sys\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653531    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-var-lib-openvswitch\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653556    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-kubelet\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653578    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-systemd-units\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653600    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-run-openvswitch\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653623    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-sysctl-d\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.653628 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653628    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-ovn-node-metrics-cert\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653651    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-kubelet\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653650    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58dgp\" (UniqueName: \"kubernetes.io/projected/bf8a3989-f2f8-4bb7-a1de-9d400bc27a70-kube-api-access-58dgp\") pod \"node-resolver-xmllx\" (UID: \"bf8a3989-f2f8-4bb7-a1de-9d400bc27a70\") " pod="openshift-dns/node-resolver-xmllx"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653680    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-var-lib-cni-multus\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653717    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-var-lib-cni-multus\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653747    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-node-log\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653747    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-var-lib-openvswitch\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653772    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgt76\" (UniqueName: \"kubernetes.io/projected/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-kube-api-access-qgt76\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653783    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-systemd-units\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653797    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-socket-dir-parent\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653729    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-run-openvswitch\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653823    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653840    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-node-log\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653848    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-run\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653872    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-sysctl-conf\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653897    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf8a3989-f2f8-4bb7-a1de-9d400bc27a70-hosts-file\") pod \"node-resolver-xmllx\" (UID: \"bf8a3989-f2f8-4bb7-a1de-9d400bc27a70\") " pod="openshift-dns/node-resolver-xmllx"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653920    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-modprobe-d\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.654219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653944    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97hkz\" (UniqueName: \"kubernetes.io/projected/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-kube-api-access-97hkz\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653954    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-socket-dir-parent\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653973    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-conf-dir\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.653997    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654009    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf8a3989-f2f8-4bb7-a1de-9d400bc27a70-hosts-file\") pod \"node-resolver-xmllx\" (UID: \"bf8a3989-f2f8-4bb7-a1de-9d400bc27a70\") " pod="openshift-dns/node-resolver-xmllx"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654024    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-cni-binary-copy\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654034    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf8a3989-f2f8-4bb7-a1de-9d400bc27a70-tmp-dir\") pod \"node-resolver-xmllx\" (UID: \"bf8a3989-f2f8-4bb7-a1de-9d400bc27a70\") " pod="openshift-dns/node-resolver-xmllx"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654038    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654055    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-run\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654037    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654063    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-daemon-config\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654106    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-conf-dir\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654119    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:49.654150    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654157    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-socket-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654165    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-sysctl-conf\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654140    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654204    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-modprobe-d\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.654913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654204    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:49.654258    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs podName:f8322035-26e8-42bd-9269-3ba2a2284d96 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:50.154200146 +0000 UTC m=+3.083796882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs") pod "network-metrics-daemon-xmtnp" (UID: "f8322035-26e8-42bd-9269-3ba2a2284d96") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654282    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddwdg\" (UniqueName: \"kubernetes.io/projected/f8322035-26e8-42bd-9269-3ba2a2284d96-kube-api-access-ddwdg\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654321    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-cnibin\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654336    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf8a3989-f2f8-4bb7-a1de-9d400bc27a70-tmp-dir\") pod \"node-resolver-xmllx\" (UID: \"bf8a3989-f2f8-4bb7-a1de-9d400bc27a70\") " pod="openshift-dns/node-resolver-xmllx"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654348    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94785fb9-7efd-46ff-b03b-70204f3bfa65-iptables-alerter-script\") pod \"iptables-alerter-r7lrv\" (UID: \"94785fb9-7efd-46ff-b03b-70204f3bfa65\") " pod="openshift-network-operator/iptables-alerter-r7lrv"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654376    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvm9\" (UniqueName: \"kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9\") pod \"network-check-target-lzlgx\" (UID: \"e9891820-0bca-47e4-8919-db86ff059d14\") " pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654401    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-cni-netd\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654417    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-cnibin\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654449    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k24x7\" (UniqueName: \"kubernetes.io/projected/b831f937-4d63-4262-8c8a-56a28dff8799-kube-api-access-k24x7\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654485    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-system-cni-dir\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654498    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-cni-netd\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654511    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbflc\" (UniqueName: \"kubernetes.io/projected/94785fb9-7efd-46ff-b03b-70204f3bfa65-kube-api-access-gbflc\") pod \"iptables-alerter-r7lrv\" (UID: \"94785fb9-7efd-46ff-b03b-70204f3bfa65\") " pod="openshift-network-operator/iptables-alerter-r7lrv"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654552    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-system-cni-dir\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654591    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-var-lib-cni-bin\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654657    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-slash\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.655741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654688    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-var-lib-cni-bin\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654694    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-run-systemd\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654700    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-slash\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654734    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-run-systemd\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654735    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-env-overrides\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654794    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-device-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654822    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-md4kq\" (UniqueName: \"kubernetes.io/projected/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-kube-api-access-md4kq\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654851    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77d15cbb-b7fe-476a-9281-d65587fc0b99-agent-certs\") pod \"konnectivity-agent-hngnv\" (UID: \"77d15cbb-b7fe-476a-9281-d65587fc0b99\") " pod="kube-system/konnectivity-agent-hngnv"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654860    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/94785fb9-7efd-46ff-b03b-70204f3bfa65-iptables-alerter-script\") pod \"iptables-alerter-r7lrv\" (UID: \"94785fb9-7efd-46ff-b03b-70204f3bfa65\") " pod="openshift-network-operator/iptables-alerter-r7lrv"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654879    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-systemd\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654912    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-tuned\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654934    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b28595cf-e76f-4d05-90ed-853ca86a467c-tmp\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.654978    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-systemd\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655057    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-system-cni-dir\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655090    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-cnibin\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655113    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-cni-bin\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655133    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-host\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655141    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-env-overrides\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.656500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655155    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77d15cbb-b7fe-476a-9281-d65587fc0b99-konnectivity-ca\") pod \"konnectivity-agent-hngnv\" (UID: \"77d15cbb-b7fe-476a-9281-d65587fc0b99\") " pod="kube-system/konnectivity-agent-hngnv"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655193    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70a22dd4-17d1-4946-9a36-891f152790aa-host\") pod \"node-ca-7g48h\" (UID: \"70a22dd4-17d1-4946-9a36-891f152790aa\") " pod="openshift-image-registry/node-ca-7g48h"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655240    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70a22dd4-17d1-4946-9a36-891f152790aa-serviceca\") pod \"node-ca-7g48h\" (UID: \"70a22dd4-17d1-4946-9a36-891f152790aa\") " pod="openshift-image-registry/node-ca-7g48h"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655267    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6gd\" (UniqueName: \"kubernetes.io/projected/70a22dd4-17d1-4946-9a36-891f152790aa-kube-api-access-ps6gd\") pod \"node-ca-7g48h\" (UID: \"70a22dd4-17d1-4946-9a36-891f152790aa\") " pod="openshift-image-registry/node-ca-7g48h"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655293    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-lib-modules\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655318    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-cnibin\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655326    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-run-ovn\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655362    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-log-socket\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655369    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-system-cni-dir\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655399    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655413    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70a22dd4-17d1-4946-9a36-891f152790aa-host\") pod \"node-ca-7g48h\" (UID: \"70a22dd4-17d1-4946-9a36-891f152790aa\") " pod="openshift-image-registry/node-ca-7g48h"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655425    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-os-release\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655485    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-run-k8s-cni-cncf-io\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655507    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-etc-kubernetes\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655528    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-var-lib-kubelet\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655553    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7c8wd\" (UniqueName: \"kubernetes.io/projected/b28595cf-e76f-4d05-90ed-853ca86a467c-kube-api-access-7c8wd\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655588    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-sysconfig\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655614    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94785fb9-7efd-46ff-b03b-70204f3bfa65-host-slash\") pod \"iptables-alerter-r7lrv\" (UID: \"94785fb9-7efd-46ff-b03b-70204f3bfa65\") " pod="openshift-network-operator/iptables-alerter-r7lrv"
May 20 20:48:49.657251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655639    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-cni-dir\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655660    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-cni-bin\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655663    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-run-netns\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655707    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-ovnkube-script-lib\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655718    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-host-run-netns\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655737    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-registration-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655761    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-log-socket\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655766    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-etc-selinux\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655792    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-sys-fs\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655797    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70a22dd4-17d1-4946-9a36-891f152790aa-serviceca\") pod \"node-ca-7g48h\" (UID: \"70a22dd4-17d1-4946-9a36-891f152790aa\") " pod="openshift-image-registry/node-ca-7g48h"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655816    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-var-lib-kubelet\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655851    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-run-multus-certs\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655877    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-etc-openvswitch\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655921    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-ovnkube-config\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655954    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655983    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-kubernetes\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656009    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-os-release\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.658048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656050    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-cni-binary-copy\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656285    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656341    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-ovnkube-script-lib\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656364    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-os-release\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656403    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-run-k8s-cni-cncf-io\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656454    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94785fb9-7efd-46ff-b03b-70204f3bfa65-host-slash\") pod \"iptables-alerter-r7lrv\" (UID: \"94785fb9-7efd-46ff-b03b-70204f3bfa65\") " pod="openshift-network-operator/iptables-alerter-r7lrv"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656455    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-sysconfig\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655613    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77d15cbb-b7fe-476a-9281-d65587fc0b99-konnectivity-ca\") pod \"konnectivity-agent-hngnv\" (UID: \"77d15cbb-b7fe-476a-9281-d65587fc0b99\") " pod="kube-system/konnectivity-agent-hngnv"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656482    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-etc-kubernetes\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656520    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-multus-cni-dir\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656533    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-etc-openvswitch\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656543    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-host\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656561    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-run-ovn\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656562    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-cni-binary-copy\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.655854    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-var-lib-kubelet\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656630    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-var-lib-kubelet\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656742    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-host-run-multus-certs\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656789    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-kubernetes\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.658752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656802    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-os-release\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.659593 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.656884    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b28595cf-e76f-4d05-90ed-853ca86a467c-lib-modules\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.659593 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.657025    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-ovnkube-config\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.659593 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.658169    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b28595cf-e76f-4d05-90ed-853ca86a467c-etc-tuned\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.659593 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.658280    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-ovn-node-metrics-cert\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.659593 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.658454    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77d15cbb-b7fe-476a-9281-d65587fc0b99-agent-certs\") pod \"konnectivity-agent-hngnv\" (UID: \"77d15cbb-b7fe-476a-9281-d65587fc0b99\") " pod="kube-system/konnectivity-agent-hngnv"
May 20 20:48:49.659593 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.659393    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b28595cf-e76f-4d05-90ed-853ca86a467c-tmp\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.661422 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:49.661369    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:48:49.661611 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:49.661590    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:48:49.661611 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:49.661617    2556 projected.go:194] Error preparing data for projected volume kube-api-access-qcvm9 for pod openshift-network-diagnostics/network-check-target-lzlgx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:49.661611 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:49.661678    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9 podName:e9891820-0bca-47e4-8919-db86ff059d14 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:50.161660552 +0000 UTC m=+3.091257278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qcvm9" (UniqueName: "kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9") pod "network-check-target-lzlgx" (UID: "e9891820-0bca-47e4-8919-db86ff059d14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:49.663180 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.663121    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddwdg\" (UniqueName: \"kubernetes.io/projected/f8322035-26e8-42bd-9269-3ba2a2284d96-kube-api-access-ddwdg\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:49.664499 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.664479    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgt76\" (UniqueName: \"kubernetes.io/projected/a9dded21-8182-4f0d-8d9f-1d7ee33314ae-kube-api-access-qgt76\") pod \"ovnkube-node-dfxdb\" (UID: \"a9dded21-8182-4f0d-8d9f-1d7ee33314ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.665290 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.664763    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbflc\" (UniqueName: \"kubernetes.io/projected/94785fb9-7efd-46ff-b03b-70204f3bfa65-kube-api-access-gbflc\") pod \"iptables-alerter-r7lrv\" (UID: \"94785fb9-7efd-46ff-b03b-70204f3bfa65\") " pod="openshift-network-operator/iptables-alerter-r7lrv"
May 20 20:48:49.665290 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.665218    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97hkz\" (UniqueName: \"kubernetes.io/projected/c0ec725c-067e-4f6d-a767-fbdc82cd6bd3-kube-api-access-97hkz\") pod \"multus-additional-cni-plugins-h629x\" (UID: \"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3\") " pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.665776 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.665740    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58dgp\" (UniqueName: \"kubernetes.io/projected/bf8a3989-f2f8-4bb7-a1de-9d400bc27a70-kube-api-access-58dgp\") pod \"node-resolver-xmllx\" (UID: \"bf8a3989-f2f8-4bb7-a1de-9d400bc27a70\") " pod="openshift-dns/node-resolver-xmllx"
May 20 20:48:49.665924 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.665897    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md4kq\" (UniqueName: \"kubernetes.io/projected/63402a4a-5a2e-4982-bcbd-8b4a1873ff73-kube-api-access-md4kq\") pod \"multus-xc75b\" (UID: \"63402a4a-5a2e-4982-bcbd-8b4a1873ff73\") " pod="openshift-multus/multus-xc75b"
May 20 20:48:49.666813 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.666794    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps6gd\" (UniqueName: \"kubernetes.io/projected/70a22dd4-17d1-4946-9a36-891f152790aa-kube-api-access-ps6gd\") pod \"node-ca-7g48h\" (UID: \"70a22dd4-17d1-4946-9a36-891f152790aa\") " pod="openshift-image-registry/node-ca-7g48h"
May 20 20:48:49.666886 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.666837    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c8wd\" (UniqueName: \"kubernetes.io/projected/b28595cf-e76f-4d05-90ed-853ca86a467c-kube-api-access-7c8wd\") pod \"tuned-qs7qh\" (UID: \"b28595cf-e76f-4d05-90ed-853ca86a467c\") " pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.756862 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.756762    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-socket-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.756862 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.756800    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k24x7\" (UniqueName: \"kubernetes.io/projected/b831f937-4d63-4262-8c8a-56a28dff8799-kube-api-access-k24x7\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.756862 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.756829    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-device-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.756862 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.756860    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-registration-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.757147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.756912    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-etc-selinux\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.757147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.756938    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-sys-fs\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.757147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.756965    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.757147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.756971    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-device-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.757147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.757036    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.757147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.757038    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-etc-selinux\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.757147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.757046    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-socket-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.757147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.757085    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-registration-dir\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.757147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.757087    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b831f937-4d63-4262-8c8a-56a28dff8799-sys-fs\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.773201 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.773174    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k24x7\" (UniqueName: \"kubernetes.io/projected/b831f937-4d63-4262-8c8a-56a28dff8799-kube-api-access-k24x7\") pod \"aws-ebs-csi-driver-node-plj5m\" (UID: \"b831f937-4d63-4262-8c8a-56a28dff8799\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:49.818137 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.818107    2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:48:49.843483 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.843455    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xmllx"
May 20 20:48:49.851272 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.851251    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h629x"
May 20 20:48:49.859938 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.859919    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r7lrv"
May 20 20:48:49.866482 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.866463    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hngnv"
May 20 20:48:49.874044 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.874027    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xc75b"
May 20 20:48:49.880519 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.880501    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7g48h"
May 20 20:48:49.888021 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.888005    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qs7qh"
May 20 20:48:49.894644 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.894624    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:48:49.899186 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:49.899172    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m"
May 20 20:48:50.160668 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.160587    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:50.160798 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:50.160707    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:50.160798 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:50.160766    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs podName:f8322035-26e8-42bd-9269-3ba2a2284d96 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:51.160750626 +0000 UTC m=+4.090347348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs") pod "network-metrics-daemon-xmtnp" (UID: "f8322035-26e8-42bd-9269-3ba2a2284d96") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:50.178959 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:50.178931    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63402a4a_5a2e_4982_bcbd_8b4a1873ff73.slice/crio-c544420f929ac008513bac646e2f7fa6e90e014847c3e191562a996e8c0d3704 WatchSource:0}: Error finding container c544420f929ac008513bac646e2f7fa6e90e014847c3e191562a996e8c0d3704: Status 404 returned error can't find the container with id c544420f929ac008513bac646e2f7fa6e90e014847c3e191562a996e8c0d3704
May 20 20:48:50.180743 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:50.180715    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf8a3989_f2f8_4bb7_a1de_9d400bc27a70.slice/crio-a6955f553ae549c46fac276d73f39d0f0a6032182eefc600eec6b73a6e9bd91d WatchSource:0}: Error finding container a6955f553ae549c46fac276d73f39d0f0a6032182eefc600eec6b73a6e9bd91d: Status 404 returned error can't find the container with id a6955f553ae549c46fac276d73f39d0f0a6032182eefc600eec6b73a6e9bd91d
May 20 20:48:50.181094 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:50.181068    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9dded21_8182_4f0d_8d9f_1d7ee33314ae.slice/crio-9a2d310c8f0a62668b6316f402612b877af0c6e631d29616f872237f74703f55 WatchSource:0}: Error finding container 9a2d310c8f0a62668b6316f402612b877af0c6e631d29616f872237f74703f55: Status 404 returned error can't find the container with id 9a2d310c8f0a62668b6316f402612b877af0c6e631d29616f872237f74703f55
May 20 20:48:50.184907 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:50.184826    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ec725c_067e_4f6d_a767_fbdc82cd6bd3.slice/crio-0f66bd7cfc416c57e1c01711738f03861b18da6c12720dedd173de912b03d38a WatchSource:0}: Error finding container 0f66bd7cfc416c57e1c01711738f03861b18da6c12720dedd173de912b03d38a: Status 404 returned error can't find the container with id 0f66bd7cfc416c57e1c01711738f03861b18da6c12720dedd173de912b03d38a
May 20 20:48:50.185566 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:50.185539    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d15cbb_b7fe_476a_9281_d65587fc0b99.slice/crio-4b14f248fc4d0b14cae92d6b4470b51a39bc4b1d75fdf6d40f7150bd89c31529 WatchSource:0}: Error finding container 4b14f248fc4d0b14cae92d6b4470b51a39bc4b1d75fdf6d40f7150bd89c31529: Status 404 returned error can't find the container with id 4b14f248fc4d0b14cae92d6b4470b51a39bc4b1d75fdf6d40f7150bd89c31529
May 20 20:48:50.186365 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:50.186348    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a22dd4_17d1_4946_9a36_891f152790aa.slice/crio-1e51094909011124c13e06a2404f45f3a3aa183b76d77ff56839eca40085070d WatchSource:0}: Error finding container 1e51094909011124c13e06a2404f45f3a3aa183b76d77ff56839eca40085070d: Status 404 returned error can't find the container with id 1e51094909011124c13e06a2404f45f3a3aa183b76d77ff56839eca40085070d
May 20 20:48:50.187136 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:48:50.187087    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28595cf_e76f_4d05_90ed_853ca86a467c.slice/crio-76810a2aee4fa88f1f68cfe3b6a2a18fe4568e0b8e631a9fdd8cd10cdaaa9055 WatchSource:0}: Error finding container 76810a2aee4fa88f1f68cfe3b6a2a18fe4568e0b8e631a9fdd8cd10cdaaa9055: Status 404 returned error can't find the container with id 76810a2aee4fa88f1f68cfe3b6a2a18fe4568e0b8e631a9fdd8cd10cdaaa9055
May 20 20:48:50.260968 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.260930    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvm9\" (UniqueName: \"kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9\") pod \"network-check-target-lzlgx\" (UID: \"e9891820-0bca-47e4-8919-db86ff059d14\") " pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:50.261065 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:50.261052    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:48:50.261112 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:50.261070    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:48:50.261112 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:50.261082    2556 projected.go:194] Error preparing data for projected volume kube-api-access-qcvm9 for pod openshift-network-diagnostics/network-check-target-lzlgx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:50.261193 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:50.261131    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9 podName:e9891820-0bca-47e4-8919-db86ff059d14 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:51.261113398 +0000 UTC m=+4.190710122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcvm9" (UniqueName: "kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9") pod "network-check-target-lzlgx" (UID: "e9891820-0bca-47e4-8919-db86ff059d14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:50.585498 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.585409    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 20:43:48 +0000 UTC" deadline="2028-01-31 10:50:05.345498432 +0000 UTC"
May 20 20:48:50.585498 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.585461    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14894h1m14.760040696s"
May 20 20:48:50.671022 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.670957    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:50.671157 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:50.671131    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:48:50.686823 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.686790    2556 generic.go:358] "Generic (PLEG): container finished" podID="34ffa07bae13a4659fa95a14729022c1" containerID="841cb7a1287ff014f9b65725eaf2601473465028334fbd30ecc1c92baeee2d2e" exitCode=0
May 20 20:48:50.687394 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.687350    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal" event={"ID":"34ffa07bae13a4659fa95a14729022c1","Type":"ContainerDied","Data":"841cb7a1287ff014f9b65725eaf2601473465028334fbd30ecc1c92baeee2d2e"}
May 20 20:48:50.700786 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.699966    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r7lrv" event={"ID":"94785fb9-7efd-46ff-b03b-70204f3bfa65","Type":"ContainerStarted","Data":"d3cf1d122c2835d3880cf402f809f7034e499467d7a72ffb9e5f4cd2b8cab6f4"}
May 20 20:48:50.720029 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.719958    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qs7qh" event={"ID":"b28595cf-e76f-4d05-90ed-853ca86a467c","Type":"ContainerStarted","Data":"76810a2aee4fa88f1f68cfe3b6a2a18fe4568e0b8e631a9fdd8cd10cdaaa9055"}
May 20 20:48:50.722068 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.721998    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hngnv" event={"ID":"77d15cbb-b7fe-476a-9281-d65587fc0b99","Type":"ContainerStarted","Data":"4b14f248fc4d0b14cae92d6b4470b51a39bc4b1d75fdf6d40f7150bd89c31529"}
May 20 20:48:50.729565 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.729492    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb" event={"ID":"a9dded21-8182-4f0d-8d9f-1d7ee33314ae","Type":"ContainerStarted","Data":"9a2d310c8f0a62668b6316f402612b877af0c6e631d29616f872237f74703f55"}
May 20 20:48:50.738023 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.737992    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xmllx" event={"ID":"bf8a3989-f2f8-4bb7-a1de-9d400bc27a70","Type":"ContainerStarted","Data":"a6955f553ae549c46fac276d73f39d0f0a6032182eefc600eec6b73a6e9bd91d"}
May 20 20:48:50.740219 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.740190    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xc75b" event={"ID":"63402a4a-5a2e-4982-bcbd-8b4a1873ff73","Type":"ContainerStarted","Data":"c544420f929ac008513bac646e2f7fa6e90e014847c3e191562a996e8c0d3704"}
May 20 20:48:50.750324 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.750295    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-248.ec2.internal" event={"ID":"720b70deb7ab5afafdb209777059a35b","Type":"ContainerStarted","Data":"5fe52ed913a42ecda58c0bea741f0cfdb07238ad27e387a3f668325a54a88470"}
May 20 20:48:50.753824 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.753658    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m" event={"ID":"b831f937-4d63-4262-8c8a-56a28dff8799","Type":"ContainerStarted","Data":"1396f3f3fbceab824ba6bc036f6af0ad6515dadd5132863870f6b246e0338263"}
May 20 20:48:50.763245 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.763192    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-248.ec2.internal" podStartSLOduration=1.76317783 podStartE2EDuration="1.76317783s" podCreationTimestamp="2026-05-20 20:48:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:48:50.763055643 +0000 UTC m=+3.692652383" watchObservedRunningTime="2026-05-20 20:48:50.76317783 +0000 UTC m=+3.692774570"
May 20 20:48:50.764280 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.764250    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7g48h" event={"ID":"70a22dd4-17d1-4946-9a36-891f152790aa","Type":"ContainerStarted","Data":"1e51094909011124c13e06a2404f45f3a3aa183b76d77ff56839eca40085070d"}
May 20 20:48:50.780305 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:50.780265    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h629x" event={"ID":"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3","Type":"ContainerStarted","Data":"0f66bd7cfc416c57e1c01711738f03861b18da6c12720dedd173de912b03d38a"}
May 20 20:48:51.168720 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:51.168630    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:51.168893 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:51.168774    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:51.168893 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:51.168845    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs podName:f8322035-26e8-42bd-9269-3ba2a2284d96 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:53.168824509 +0000 UTC m=+6.098421240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs") pod "network-metrics-daemon-xmtnp" (UID: "f8322035-26e8-42bd-9269-3ba2a2284d96") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:51.270022 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:51.269983    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvm9\" (UniqueName: \"kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9\") pod \"network-check-target-lzlgx\" (UID: \"e9891820-0bca-47e4-8919-db86ff059d14\") " pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:51.270211 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:51.270193    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:48:51.270280 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:51.270219    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:48:51.270280 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:51.270233    2556 projected.go:194] Error preparing data for projected volume kube-api-access-qcvm9 for pod openshift-network-diagnostics/network-check-target-lzlgx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:51.270381 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:51.270293    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9 podName:e9891820-0bca-47e4-8919-db86ff059d14 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:53.270274828 +0000 UTC m=+6.199871551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcvm9" (UniqueName: "kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9") pod "network-check-target-lzlgx" (UID: "e9891820-0bca-47e4-8919-db86ff059d14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:51.673788 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:51.673531    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:51.674209 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:51.673856    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:48:51.813373 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:51.813185    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal" event={"ID":"34ffa07bae13a4659fa95a14729022c1","Type":"ContainerStarted","Data":"732a61101f0cff18f110fc86ec9afdf80df32fadf07c9c8d3a96148a482ee959"}
May 20 20:48:52.671242 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:52.671209    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:52.671421 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:52.671358    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:48:53.184560 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:53.184526    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:53.184998 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:53.184749    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:53.184998 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:53.184821    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs podName:f8322035-26e8-42bd-9269-3ba2a2284d96 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:57.184801495 +0000 UTC m=+10.114398225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs") pod "network-metrics-daemon-xmtnp" (UID: "f8322035-26e8-42bd-9269-3ba2a2284d96") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:53.285419 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:53.285347    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvm9\" (UniqueName: \"kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9\") pod \"network-check-target-lzlgx\" (UID: \"e9891820-0bca-47e4-8919-db86ff059d14\") " pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:53.285594 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:53.285559    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:48:53.285594 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:53.285578    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:48:53.285594 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:53.285591    2556 projected.go:194] Error preparing data for projected volume kube-api-access-qcvm9 for pod openshift-network-diagnostics/network-check-target-lzlgx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:53.285771 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:53.285644    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9 podName:e9891820-0bca-47e4-8919-db86ff059d14 nodeName:}" failed. No retries permitted until 2026-05-20 20:48:57.285626945 +0000 UTC m=+10.215223669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcvm9" (UniqueName: "kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9") pod "network-check-target-lzlgx" (UID: "e9891820-0bca-47e4-8919-db86ff059d14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:53.671517 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:53.671444    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:53.671677 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:53.671590    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:48:54.670609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:54.670576    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:54.671049 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:54.670748    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:48:55.671173 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:55.671131    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:55.671633 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:55.671276    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:48:56.670501 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:56.670467    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:56.670677 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:56.670593    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:48:57.218926 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:57.218889    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:57.219398 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:57.219026    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:57.219398 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:57.219094    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs podName:f8322035-26e8-42bd-9269-3ba2a2284d96 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:05.219072046 +0000 UTC m=+18.148668787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs") pod "network-metrics-daemon-xmtnp" (UID: "f8322035-26e8-42bd-9269-3ba2a2284d96") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:48:57.320013 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:57.319975    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvm9\" (UniqueName: \"kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9\") pod \"network-check-target-lzlgx\" (UID: \"e9891820-0bca-47e4-8919-db86ff059d14\") " pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:57.320196 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:57.320158    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:48:57.320196 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:57.320184    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:48:57.320196 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:57.320198    2556 projected.go:194] Error preparing data for projected volume kube-api-access-qcvm9 for pod openshift-network-diagnostics/network-check-target-lzlgx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:57.320321 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:57.320269    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9 podName:e9891820-0bca-47e4-8919-db86ff059d14 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:05.320249393 +0000 UTC m=+18.249846132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcvm9" (UniqueName: "kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9") pod "network-check-target-lzlgx" (UID: "e9891820-0bca-47e4-8919-db86ff059d14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:48:57.672196 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:57.672123    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:57.672346 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:57.672249    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:48:58.670719 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:58.670686    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:48:58.671175 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:58.670791    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:48:59.671100 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:48:59.671066    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:48:59.671600 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:48:59.671198    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:00.671217 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:00.671143    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:00.671636 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:00.671275    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:01.670277 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:01.670244    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:01.670467 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:01.670388    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:02.670821 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:02.670790    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:02.671256 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:02.670890    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:03.671080 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:03.671048    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:03.671597 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:03.671157    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:04.670540 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:04.670509    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:04.670737 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:04.670611    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:05.272577 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:05.272540    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:05.272951 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:05.272698    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:49:05.272951 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:05.272778    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs podName:f8322035-26e8-42bd-9269-3ba2a2284d96 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:21.272759278 +0000 UTC m=+34.202356020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs") pod "network-metrics-daemon-xmtnp" (UID: "f8322035-26e8-42bd-9269-3ba2a2284d96") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:49:05.373038 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:05.373007    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvm9\" (UniqueName: \"kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9\") pod \"network-check-target-lzlgx\" (UID: \"e9891820-0bca-47e4-8919-db86ff059d14\") " pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:05.373220 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:05.373126    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:49:05.373220 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:05.373143    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:49:05.373220 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:05.373153    2556 projected.go:194] Error preparing data for projected volume kube-api-access-qcvm9 for pod openshift-network-diagnostics/network-check-target-lzlgx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:49:05.373220 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:05.373203    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9 podName:e9891820-0bca-47e4-8919-db86ff059d14 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:21.373190548 +0000 UTC m=+34.302787278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcvm9" (UniqueName: "kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9") pod "network-check-target-lzlgx" (UID: "e9891820-0bca-47e4-8919-db86ff059d14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:49:05.670240 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:05.670204    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:05.670405 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:05.670350    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:06.670567 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:06.670528    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:06.670936 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:06.670663    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:07.670966 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:07.670929    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:07.671376 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:07.671043    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:08.670641 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.670414    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:08.670826 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:08.670750    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:08.850639 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.850616    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hngnv" event={"ID":"77d15cbb-b7fe-476a-9281-d65587fc0b99","Type":"ContainerStarted","Data":"0d6c4c70c7404335e253cecf2aeeccd0749325317e387c259a8422f1b329881d"}
May 20 20:49:08.852547 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.852524    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb" event={"ID":"a9dded21-8182-4f0d-8d9f-1d7ee33314ae","Type":"ContainerStarted","Data":"65f2cf2c471f75cad4429f98fc80c5bf743a708a4bda691639d7fd8fb4110e11"}
May 20 20:49:08.852627 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.852552    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb" event={"ID":"a9dded21-8182-4f0d-8d9f-1d7ee33314ae","Type":"ContainerStarted","Data":"3f6f4909a5ef20757650aa92e91103ad254c37b7cb7d0c72ad247cac8af27b80"}
May 20 20:49:08.852627 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.852562    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb" event={"ID":"a9dded21-8182-4f0d-8d9f-1d7ee33314ae","Type":"ContainerStarted","Data":"d352ca513308e7167f4ddaee0a4f7919a4efc3434463f925896d0ad4eea6c56e"}
May 20 20:49:08.852627 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.852570    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb" event={"ID":"a9dded21-8182-4f0d-8d9f-1d7ee33314ae","Type":"ContainerStarted","Data":"6051762c63acad866863938fd0bcb5535ded22d0bb94606792bc80c32149b6f1"}
May 20 20:49:08.853653 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.853628    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xmllx" event={"ID":"bf8a3989-f2f8-4bb7-a1de-9d400bc27a70","Type":"ContainerStarted","Data":"72030920ccd3e50c4d583e04451bb723994809f4d57189cad4bcf696d611b8b8"}
May 20 20:49:08.857382 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.857359    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xc75b" event={"ID":"63402a4a-5a2e-4982-bcbd-8b4a1873ff73","Type":"ContainerStarted","Data":"ac936751c590769e32c5b517b24d5b70d13dbd22be45312887adc0b153df6b90"}
May 20 20:49:08.858416 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.858396    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m" event={"ID":"b831f937-4d63-4262-8c8a-56a28dff8799","Type":"ContainerStarted","Data":"d715cf2677612d11ac7b742338ff1bf701edd8a2eae6edbeba406e553cdcef0d"}
May 20 20:49:08.859507 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.859488    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7g48h" event={"ID":"70a22dd4-17d1-4946-9a36-891f152790aa","Type":"ContainerStarted","Data":"99957326526d5942ae1138fc18cbedbf77e118fc33896f2dd50b38c733c36249"}
May 20 20:49:08.860636 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.860614    2556 generic.go:358] "Generic (PLEG): container finished" podID="c0ec725c-067e-4f6d-a767-fbdc82cd6bd3" containerID="9dbd38f8c6e153b088ca1ac03aa2febcd56bc66a4d89baa3a2bcba93a0f96811" exitCode=0
May 20 20:49:08.860701 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.860688    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h629x" event={"ID":"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3","Type":"ContainerDied","Data":"9dbd38f8c6e153b088ca1ac03aa2febcd56bc66a4d89baa3a2bcba93a0f96811"}
May 20 20:49:08.861933 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.861821    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qs7qh" event={"ID":"b28595cf-e76f-4d05-90ed-853ca86a467c","Type":"ContainerStarted","Data":"7e1ebfde9446e5029d0b37b1c5fd5b66c96dad83c47f70c3404322fd33a7defe"}
May 20 20:49:08.884054 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.884015    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-248.ec2.internal" podStartSLOduration=19.884005885 podStartE2EDuration="19.884005885s" podCreationTimestamp="2026-05-20 20:48:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:48:51.830649532 +0000 UTC m=+4.760246271" watchObservedRunningTime="2026-05-20 20:49:08.884005885 +0000 UTC m=+21.813602624"
May 20 20:49:08.903009 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.902957    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-xmllx" podStartSLOduration=3.67015326 podStartE2EDuration="21.9029465s" podCreationTimestamp="2026-05-20 20:48:47 +0000 UTC" firstStartedPulling="2026-05-20 20:48:50.183335529 +0000 UTC m=+3.112932259" lastFinishedPulling="2026-05-20 20:49:08.416128777 +0000 UTC m=+21.345725499" observedRunningTime="2026-05-20 20:49:08.898103467 +0000 UTC m=+21.827700206" watchObservedRunningTime="2026-05-20 20:49:08.9029465 +0000 UTC m=+21.832543238"
May 20 20:49:08.914603 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.914564    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hngnv" podStartSLOduration=3.6872343709999997 podStartE2EDuration="21.914554864s" podCreationTimestamp="2026-05-20 20:48:47 +0000 UTC" firstStartedPulling="2026-05-20 20:48:50.188474832 +0000 UTC m=+3.118071552" lastFinishedPulling="2026-05-20 20:49:08.415795326 +0000 UTC m=+21.345392045" observedRunningTime="2026-05-20 20:49:08.914182826 +0000 UTC m=+21.843779564" watchObservedRunningTime="2026-05-20 20:49:08.914554864 +0000 UTC m=+21.844151603"
May 20 20:49:08.944687 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.944653    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xc75b" podStartSLOduration=3.653270536 podStartE2EDuration="21.94464355s" podCreationTimestamp="2026-05-20 20:48:47 +0000 UTC" firstStartedPulling="2026-05-20 20:48:50.181627788 +0000 UTC m=+3.111224521" lastFinishedPulling="2026-05-20 20:49:08.473000818 +0000 UTC m=+21.402597535" observedRunningTime="2026-05-20 20:49:08.930839445 +0000 UTC m=+21.860436184" watchObservedRunningTime="2026-05-20 20:49:08.94464355 +0000 UTC m=+21.874240289"
May 20 20:49:08.961696 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.961664    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qs7qh" podStartSLOduration=3.735392456 podStartE2EDuration="21.961653857s" podCreationTimestamp="2026-05-20 20:48:47 +0000 UTC" firstStartedPulling="2026-05-20 20:48:50.19079338 +0000 UTC m=+3.120390108" lastFinishedPulling="2026-05-20 20:49:08.417054793 +0000 UTC m=+21.346651509" observedRunningTime="2026-05-20 20:49:08.961546749 +0000 UTC m=+21.891143487" watchObservedRunningTime="2026-05-20 20:49:08.961653857 +0000 UTC m=+21.891250595"
May 20 20:49:08.961913 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:08.961895    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7g48h" podStartSLOduration=11.759109623 podStartE2EDuration="21.96189001s" podCreationTimestamp="2026-05-20 20:48:47 +0000 UTC" firstStartedPulling="2026-05-20 20:48:50.188630044 +0000 UTC m=+3.118226776" lastFinishedPulling="2026-05-20 20:49:00.391410439 +0000 UTC m=+13.321007163" observedRunningTime="2026-05-20 20:49:08.944686365 +0000 UTC m=+21.874283104" watchObservedRunningTime="2026-05-20 20:49:08.96189001 +0000 UTC m=+21.891486749"
May 20 20:49:09.631285 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:09.631058    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hngnv"
May 20 20:49:09.631788 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:09.631766    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hngnv"
May 20 20:49:09.671117 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:09.671091    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:09.671240 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:09.671219    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:09.852184 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:09.852157    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 20 20:49:09.868183 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:09.868147    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r7lrv" event={"ID":"94785fb9-7efd-46ff-b03b-70204f3bfa65","Type":"ContainerStarted","Data":"7778a40357e721d64cc8b593004136df90d9389d0300cc0b80fdde18c3b3ba6f"}
May 20 20:49:09.870900 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:09.870871    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb" event={"ID":"a9dded21-8182-4f0d-8d9f-1d7ee33314ae","Type":"ContainerStarted","Data":"b7d8c995d72715988963b22bedc198fdbaf4ed9f459a611c7e87475d715a7c9f"}
May 20 20:49:09.871036 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:09.870908    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb" event={"ID":"a9dded21-8182-4f0d-8d9f-1d7ee33314ae","Type":"ContainerStarted","Data":"67c5611cb102cbad4ba69cf5a0ba8163e9074155a1e30724a26ba95c3d746fe0"}
May 20 20:49:09.872741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:09.872670    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m" event={"ID":"b831f937-4d63-4262-8c8a-56a28dff8799","Type":"ContainerStarted","Data":"35d2b267ec566f2c3e9da23917bdb4d1f00cd785ad869f4b80350dfc2fab6806"}
May 20 20:49:09.872911 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:09.872887    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hngnv"
May 20 20:49:09.873651 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:09.873632    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hngnv"
May 20 20:49:09.925511 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:09.925456    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r7lrv" podStartSLOduration=4.704592122 podStartE2EDuration="22.925423487s" podCreationTimestamp="2026-05-20 20:48:47 +0000 UTC" firstStartedPulling="2026-05-20 20:48:50.19297613 +0000 UTC m=+3.122572847" lastFinishedPulling="2026-05-20 20:49:08.413807477 +0000 UTC m=+21.343404212" observedRunningTime="2026-05-20 20:49:09.888771112 +0000 UTC m=+22.818367849" watchObservedRunningTime="2026-05-20 20:49:09.925423487 +0000 UTC m=+22.855020228"
May 20 20:49:10.608450 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:10.608349    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T20:49:09.852178023Z","UUID":"52d3d4fc-dc85-4160-b0c0-cccac1842ca4","Handler":null,"Name":"","Endpoint":""}
May 20 20:49:10.611735 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:10.611708    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 20 20:49:10.611864 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:10.611742    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 20 20:49:10.670759 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:10.670728    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:10.670921 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:10.670863    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:11.670442 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:11.670416    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:11.670975 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:11.670531    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:11.878310 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:11.878271    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m" event={"ID":"b831f937-4d63-4262-8c8a-56a28dff8799","Type":"ContainerStarted","Data":"a97a10eff0882f0fd1e360ac2347a5ea1410a74d72fea6b117237b1d42677e42"}
May 20 20:49:11.881497 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:11.881466    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb" event={"ID":"a9dded21-8182-4f0d-8d9f-1d7ee33314ae","Type":"ContainerStarted","Data":"2fb855d6350e18e1fa23a188533a48837f859562fc29f648776ef57d69b02cad"}
May 20 20:49:11.896920 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:11.896869    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plj5m" podStartSLOduration=3.99121538 podStartE2EDuration="24.89685628s" podCreationTimestamp="2026-05-20 20:48:47 +0000 UTC" firstStartedPulling="2026-05-20 20:48:50.192131134 +0000 UTC m=+3.121727866" lastFinishedPulling="2026-05-20 20:49:11.097772034 +0000 UTC m=+24.027368766" observedRunningTime="2026-05-20 20:49:11.896424798 +0000 UTC m=+24.826021537" watchObservedRunningTime="2026-05-20 20:49:11.89685628 +0000 UTC m=+24.826453019"
May 20 20:49:12.671089 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:12.671050    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:12.671666 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:12.671180    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:13.670586 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:13.670375    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:13.670737 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:13.670712    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:13.888514 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:13.888480    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb" event={"ID":"a9dded21-8182-4f0d-8d9f-1d7ee33314ae","Type":"ContainerStarted","Data":"3edcd5eeeedf20ccee78c7b806603cc329ea736026fe559e4fb26519ed59f555"}
May 20 20:49:13.888951 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:13.888784    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:49:13.888951 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:13.888816    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:49:13.890549 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:13.890511    2556 generic.go:358] "Generic (PLEG): container finished" podID="c0ec725c-067e-4f6d-a767-fbdc82cd6bd3" containerID="08587694a83e721a36df763409a27066a1bac8a8137f48eb2f22dc76a8bd85c6" exitCode=0
May 20 20:49:13.890675 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:13.890562    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h629x" event={"ID":"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3","Type":"ContainerDied","Data":"08587694a83e721a36df763409a27066a1bac8a8137f48eb2f22dc76a8bd85c6"}
May 20 20:49:13.904400 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:13.904378    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:49:13.908839 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:13.908821    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:49:13.916380 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:13.916340    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb" podStartSLOduration=8.609386337 podStartE2EDuration="26.916328944s" podCreationTimestamp="2026-05-20 20:48:47 +0000 UTC" firstStartedPulling="2026-05-20 20:48:50.183453304 +0000 UTC m=+3.113050020" lastFinishedPulling="2026-05-20 20:49:08.490395904 +0000 UTC m=+21.419992627" observedRunningTime="2026-05-20 20:49:13.915675444 +0000 UTC m=+26.845272184" watchObservedRunningTime="2026-05-20 20:49:13.916328944 +0000 UTC m=+26.845925683"
May 20 20:49:14.670800 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:14.670777    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:14.670995 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:14.670888    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:14.894090 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:14.894057    2556 generic.go:358] "Generic (PLEG): container finished" podID="c0ec725c-067e-4f6d-a767-fbdc82cd6bd3" containerID="b6690ef35586a5f696c1695fbc925ce5fad5023c6fe7afd7241f73a6476e6a0d" exitCode=0
May 20 20:49:14.894511 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:14.894140    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h629x" event={"ID":"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3","Type":"ContainerDied","Data":"b6690ef35586a5f696c1695fbc925ce5fad5023c6fe7afd7241f73a6476e6a0d"}
May 20 20:49:14.894511 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:14.894384    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 20 20:49:15.459321 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:15.459136    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lzlgx"]
May 20 20:49:15.459507 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:15.459390    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:15.459507 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:15.459493    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:15.461653 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:15.461632    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmtnp"]
May 20 20:49:15.461773 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:15.461759    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:15.461896 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:15.461874    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:15.871375 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:15.871296    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:49:15.897583 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:15.897558    2556 generic.go:358] "Generic (PLEG): container finished" podID="c0ec725c-067e-4f6d-a767-fbdc82cd6bd3" containerID="126b7f8c3b0db502074971b6bc3e6326a80ee687b366fa5880c4aab75e167e24" exitCode=0
May 20 20:49:15.898068 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:15.897642    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h629x" event={"ID":"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3","Type":"ContainerDied","Data":"126b7f8c3b0db502074971b6bc3e6326a80ee687b366fa5880c4aab75e167e24"}
May 20 20:49:17.671490 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:17.671459    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:17.672020 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:17.671572    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:17.672020 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:17.671573    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:17.672020 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:17.671670    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:19.670621 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:19.670589    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:19.671231 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:19.670595    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:19.671231 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:19.670727    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:19.671231 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:19.670798    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:21.291301 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:21.291267    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:21.291732 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:21.291451    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:49:21.291732 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:21.291521    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs podName:f8322035-26e8-42bd-9269-3ba2a2284d96 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:53.291503869 +0000 UTC m=+66.221100598 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs") pod "network-metrics-daemon-xmtnp" (UID: "f8322035-26e8-42bd-9269-3ba2a2284d96") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:49:21.392544 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:21.392464    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvm9\" (UniqueName: \"kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9\") pod \"network-check-target-lzlgx\" (UID: \"e9891820-0bca-47e4-8919-db86ff059d14\") " pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:21.392717 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:21.392654    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:49:21.392717 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:21.392678    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:49:21.392717 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:21.392690    2556 projected.go:194] Error preparing data for projected volume kube-api-access-qcvm9 for pod openshift-network-diagnostics/network-check-target-lzlgx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:49:21.392870 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:21.392748    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9 podName:e9891820-0bca-47e4-8919-db86ff059d14 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:53.392728685 +0000 UTC m=+66.322325412 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qcvm9" (UniqueName: "kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9") pod "network-check-target-lzlgx" (UID: "e9891820-0bca-47e4-8919-db86ff059d14") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:49:21.670746 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:21.670575    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:21.670878 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:21.670610    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:21.670878 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:21.670815    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzlgx" podUID="e9891820-0bca-47e4-8919-db86ff059d14"
May 20 20:49:21.670954 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:21.670897    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:49:22.427401 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.427374    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-248.ec2.internal" event="NodeReady"
May 20 20:49:22.427807 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.427530    2556 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 20 20:49:22.474037 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.474004    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9vj5g"]
May 20 20:49:22.494725 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.494693    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h2df2"]
May 20 20:49:22.494909 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.494856    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.497473 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.497450    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c2cd4\""
May 20 20:49:22.497760 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.497742    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 20 20:49:22.497842 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.497750    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 20 20:49:22.518815 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.518786    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h2df2"]
May 20 20:49:22.518815 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.518812    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9vj5g"]
May 20 20:49:22.518972 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.518907    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:22.521124 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.521102    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 20 20:49:22.521252 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.521176    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 20 20:49:22.521252 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.521194    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5vsdg\""
May 20 20:49:22.521472 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.521460    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 20 20:49:22.603252 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.603226    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/816319b6-b54d-45b8-8bdb-1f75b0e672f9-tmp-dir\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.603421 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.603261    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f927s\" (UniqueName: \"kubernetes.io/projected/48b7525a-3a26-423d-9eb2-64ea2179f1d3-kube-api-access-f927s\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:22.603421 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.603292    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/816319b6-b54d-45b8-8bdb-1f75b0e672f9-config-volume\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.603421 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.603330    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.603421 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.603368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6vqc\" (UniqueName: \"kubernetes.io/projected/816319b6-b54d-45b8-8bdb-1f75b0e672f9-kube-api-access-q6vqc\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.603421 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.603391    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:22.704479 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.704394    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6vqc\" (UniqueName: \"kubernetes.io/projected/816319b6-b54d-45b8-8bdb-1f75b0e672f9-kube-api-access-q6vqc\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.704479 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.704423    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:22.704614 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:22.704525    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:22.704614 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:22.704588    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert podName:48b7525a-3a26-423d-9eb2-64ea2179f1d3 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:23.204569282 +0000 UTC m=+36.134166020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert") pod "ingress-canary-h2df2" (UID: "48b7525a-3a26-423d-9eb2-64ea2179f1d3") : secret "canary-serving-cert" not found
May 20 20:49:22.704614 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.704608    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/816319b6-b54d-45b8-8bdb-1f75b0e672f9-tmp-dir\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.704735 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.704634    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f927s\" (UniqueName: \"kubernetes.io/projected/48b7525a-3a26-423d-9eb2-64ea2179f1d3-kube-api-access-f927s\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:22.704735 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.704685    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/816319b6-b54d-45b8-8bdb-1f75b0e672f9-config-volume\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.704735 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.704709    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.704858 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:22.704803    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:22.704858 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:22.704841    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls podName:816319b6-b54d-45b8-8bdb-1f75b0e672f9 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:23.204828564 +0000 UTC m=+36.134425295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls") pod "dns-default-9vj5g" (UID: "816319b6-b54d-45b8-8bdb-1f75b0e672f9") : secret "dns-default-metrics-tls" not found
May 20 20:49:22.704949 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.704933    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/816319b6-b54d-45b8-8bdb-1f75b0e672f9-tmp-dir\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.705226 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.705210    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/816319b6-b54d-45b8-8bdb-1f75b0e672f9-config-volume\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.715317 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.715291    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6vqc\" (UniqueName: \"kubernetes.io/projected/816319b6-b54d-45b8-8bdb-1f75b0e672f9-kube-api-access-q6vqc\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:22.715413 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.715387    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f927s\" (UniqueName: \"kubernetes.io/projected/48b7525a-3a26-423d-9eb2-64ea2179f1d3-kube-api-access-f927s\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:22.912710 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.912671    2556 generic.go:358] "Generic (PLEG): container finished" podID="c0ec725c-067e-4f6d-a767-fbdc82cd6bd3" containerID="0d58e15f656f0d287323016820f0a79a7a2c9bdcc12668e6014426e35cef4b89" exitCode=0
May 20 20:49:22.912848 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:22.912716    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h629x" event={"ID":"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3","Type":"ContainerDied","Data":"0d58e15f656f0d287323016820f0a79a7a2c9bdcc12668e6014426e35cef4b89"}
May 20 20:49:23.208381 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:23.208350    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:23.208381 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:23.208392    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:23.208634 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:23.208506    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:23.208634 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:23.208520    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:23.208634 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:23.208558    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert podName:48b7525a-3a26-423d-9eb2-64ea2179f1d3 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:24.208544297 +0000 UTC m=+37.138141027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert") pod "ingress-canary-h2df2" (UID: "48b7525a-3a26-423d-9eb2-64ea2179f1d3") : secret "canary-serving-cert" not found
May 20 20:49:23.208634 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:23.208577    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls podName:816319b6-b54d-45b8-8bdb-1f75b0e672f9 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:24.208562552 +0000 UTC m=+37.138159269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls") pod "dns-default-9vj5g" (UID: "816319b6-b54d-45b8-8bdb-1f75b0e672f9") : secret "dns-default-metrics-tls" not found
May 20 20:49:23.673174 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:23.673146    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:23.673660 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:23.673194    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:23.675753 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:23.675727    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7l2g\""
May 20 20:49:23.675885 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:23.675865    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 20:49:23.675941 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:23.675893    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 20:49:23.676415 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:23.676402    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q28sq\""
May 20 20:49:23.676501 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:23.676486    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 20:49:23.917300 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:23.917270    2556 generic.go:358] "Generic (PLEG): container finished" podID="c0ec725c-067e-4f6d-a767-fbdc82cd6bd3" containerID="29b3652bdf7a696be6c6c7723a362a148eb98024abaa58f64d5679939c2ec647" exitCode=0
May 20 20:49:23.917456 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:23.917327    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h629x" event={"ID":"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3","Type":"ContainerDied","Data":"29b3652bdf7a696be6c6c7723a362a148eb98024abaa58f64d5679939c2ec647"}
May 20 20:49:24.216153 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:24.216084    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:24.216153 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:24.216121    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:24.216324 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:24.216216    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:24.216324 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:24.216217    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:24.216324 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:24.216263    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert podName:48b7525a-3a26-423d-9eb2-64ea2179f1d3 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:26.216250092 +0000 UTC m=+39.145846809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert") pod "ingress-canary-h2df2" (UID: "48b7525a-3a26-423d-9eb2-64ea2179f1d3") : secret "canary-serving-cert" not found
May 20 20:49:24.216324 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:24.216277    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls podName:816319b6-b54d-45b8-8bdb-1f75b0e672f9 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:26.216270183 +0000 UTC m=+39.145866899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls") pod "dns-default-9vj5g" (UID: "816319b6-b54d-45b8-8bdb-1f75b0e672f9") : secret "dns-default-metrics-tls" not found
May 20 20:49:24.921675 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:24.921638    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h629x" event={"ID":"c0ec725c-067e-4f6d-a767-fbdc82cd6bd3","Type":"ContainerStarted","Data":"056aa6be1c2382f4a23198ba9462327491865100fd6c6b3567e23920231d6514"}
May 20 20:49:24.949155 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:24.949087    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h629x" podStartSLOduration=6.275424918 podStartE2EDuration="37.94907564s" podCreationTimestamp="2026-05-20 20:48:47 +0000 UTC" firstStartedPulling="2026-05-20 20:48:50.186601766 +0000 UTC m=+3.116198486" lastFinishedPulling="2026-05-20 20:49:21.860252483 +0000 UTC m=+34.789849208" observedRunningTime="2026-05-20 20:49:24.948060733 +0000 UTC m=+37.877657472" watchObservedRunningTime="2026-05-20 20:49:24.94907564 +0000 UTC m=+37.878672383"
May 20 20:49:26.229296 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:26.229251    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:26.229296 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:26.229306    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:26.229703 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:26.229390    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:26.229703 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:26.229397    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:26.229703 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:26.229455    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert podName:48b7525a-3a26-423d-9eb2-64ea2179f1d3 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:30.229423296 +0000 UTC m=+43.159020012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert") pod "ingress-canary-h2df2" (UID: "48b7525a-3a26-423d-9eb2-64ea2179f1d3") : secret "canary-serving-cert" not found
May 20 20:49:26.229703 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:26.229467    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls podName:816319b6-b54d-45b8-8bdb-1f75b0e672f9 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:30.229461682 +0000 UTC m=+43.159058398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls") pod "dns-default-9vj5g" (UID: "816319b6-b54d-45b8-8bdb-1f75b0e672f9") : secret "dns-default-metrics-tls" not found
May 20 20:49:30.252851 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:30.252688    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:30.252851 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:30.252839    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:30.253338 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:30.252861    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:30.253338 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:30.252903    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls podName:816319b6-b54d-45b8-8bdb-1f75b0e672f9 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:38.252887949 +0000 UTC m=+51.182484667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls") pod "dns-default-9vj5g" (UID: "816319b6-b54d-45b8-8bdb-1f75b0e672f9") : secret "dns-default-metrics-tls" not found
May 20 20:49:30.253338 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:30.252946    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:30.253338 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:30.252987    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert podName:48b7525a-3a26-423d-9eb2-64ea2179f1d3 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:38.2529756 +0000 UTC m=+51.182572317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert") pod "ingress-canary-h2df2" (UID: "48b7525a-3a26-423d-9eb2-64ea2179f1d3") : secret "canary-serving-cert" not found
May 20 20:49:38.305725 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:38.305676    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:38.305725 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:38.305732    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:38.306149 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:38.305822    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:38.306149 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:38.305824    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:38.306149 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:38.305873    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert podName:48b7525a-3a26-423d-9eb2-64ea2179f1d3 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:54.305860484 +0000 UTC m=+67.235457201 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert") pod "ingress-canary-h2df2" (UID: "48b7525a-3a26-423d-9eb2-64ea2179f1d3") : secret "canary-serving-cert" not found
May 20 20:49:38.306149 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:38.305887    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls podName:816319b6-b54d-45b8-8bdb-1f75b0e672f9 nodeName:}" failed. No retries permitted until 2026-05-20 20:49:54.305880859 +0000 UTC m=+67.235477576 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls") pod "dns-default-9vj5g" (UID: "816319b6-b54d-45b8-8bdb-1f75b0e672f9") : secret "dns-default-metrics-tls" not found
May 20 20:49:46.909840 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:46.909796    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfxdb"
May 20 20:49:53.305716 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:53.305672    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:49:53.308532 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:53.308513    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 20:49:53.316792 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:53.316774    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 20:49:53.316865 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:53.316843    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs podName:f8322035-26e8-42bd-9269-3ba2a2284d96 nodeName:}" failed. No retries permitted until 2026-05-20 20:50:57.316821528 +0000 UTC m=+130.246418266 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs") pod "network-metrics-daemon-xmtnp" (UID: "f8322035-26e8-42bd-9269-3ba2a2284d96") : secret "metrics-daemon-secret" not found
May 20 20:49:53.406326 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:53.406299    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcvm9\" (UniqueName: \"kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9\") pod \"network-check-target-lzlgx\" (UID: \"e9891820-0bca-47e4-8919-db86ff059d14\") " pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:53.408877 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:53.408861    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 20:49:53.419512 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:53.419492    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 20:49:53.430791 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:53.430768    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcvm9\" (UniqueName: \"kubernetes.io/projected/e9891820-0bca-47e4-8919-db86ff059d14-kube-api-access-qcvm9\") pod \"network-check-target-lzlgx\" (UID: \"e9891820-0bca-47e4-8919-db86ff059d14\") " pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:53.689701 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:53.689673    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7l2g\""
May 20 20:49:53.697875 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:53.697858    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:53.872758 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:53.872726    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lzlgx"]
May 20 20:49:53.876812 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:49:53.876778    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9891820_0bca_47e4_8919_db86ff059d14.slice/crio-a9bdcf5870c84252b9ac496451c77f998942593dccd4939380302dd47fe4e24a WatchSource:0}: Error finding container a9bdcf5870c84252b9ac496451c77f998942593dccd4939380302dd47fe4e24a: Status 404 returned error can't find the container with id a9bdcf5870c84252b9ac496451c77f998942593dccd4939380302dd47fe4e24a
May 20 20:49:53.974617 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:53.974537    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lzlgx" event={"ID":"e9891820-0bca-47e4-8919-db86ff059d14","Type":"ContainerStarted","Data":"a9bdcf5870c84252b9ac496451c77f998942593dccd4939380302dd47fe4e24a"}
May 20 20:49:54.313963 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:54.313898    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:49:54.313963 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:54.313936    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:49:54.314364 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:54.314032    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:49:54.314364 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:54.314080    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert podName:48b7525a-3a26-423d-9eb2-64ea2179f1d3 nodeName:}" failed. No retries permitted until 2026-05-20 20:50:26.314065174 +0000 UTC m=+99.243661904 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert") pod "ingress-canary-h2df2" (UID: "48b7525a-3a26-423d-9eb2-64ea2179f1d3") : secret "canary-serving-cert" not found
May 20 20:49:54.314364 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:54.314032    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:49:54.314364 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:49:54.314179    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls podName:816319b6-b54d-45b8-8bdb-1f75b0e672f9 nodeName:}" failed. No retries permitted until 2026-05-20 20:50:26.314164671 +0000 UTC m=+99.243761393 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls") pod "dns-default-9vj5g" (UID: "816319b6-b54d-45b8-8bdb-1f75b0e672f9") : secret "dns-default-metrics-tls" not found
May 20 20:49:56.981637 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:56.981595    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lzlgx" event={"ID":"e9891820-0bca-47e4-8919-db86ff059d14","Type":"ContainerStarted","Data":"ff5e3213dbab37610fdc532a2cd9d71f195fe62d7221f3631395acc0e0dda3e0"}
May 20 20:49:56.982048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:56.981733    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:49:57.001632 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:49:57.001584    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lzlgx" podStartSLOduration=67.394086146 podStartE2EDuration="1m10.001572955s" podCreationTimestamp="2026-05-20 20:48:47 +0000 UTC" firstStartedPulling="2026-05-20 20:49:53.878576075 +0000 UTC m=+66.808172795" lastFinishedPulling="2026-05-20 20:49:56.486062885 +0000 UTC m=+69.415659604" observedRunningTime="2026-05-20 20:49:57.00101081 +0000 UTC m=+69.930607569" watchObservedRunningTime="2026-05-20 20:49:57.001572955 +0000 UTC m=+69.931169685"
May 20 20:50:26.323944 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:26.323900    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:50:26.323944 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:26.323948    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:50:26.324391 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:26.324050    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:50:26.324391 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:26.324056    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:50:26.324391 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:26.324105    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert podName:48b7525a-3a26-423d-9eb2-64ea2179f1d3 nodeName:}" failed. No retries permitted until 2026-05-20 20:51:30.324091518 +0000 UTC m=+163.253688248 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert") pod "ingress-canary-h2df2" (UID: "48b7525a-3a26-423d-9eb2-64ea2179f1d3") : secret "canary-serving-cert" not found
May 20 20:50:26.324391 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:26.324118    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls podName:816319b6-b54d-45b8-8bdb-1f75b0e672f9 nodeName:}" failed. No retries permitted until 2026-05-20 20:51:30.324112601 +0000 UTC m=+163.253709318 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls") pod "dns-default-9vj5g" (UID: "816319b6-b54d-45b8-8bdb-1f75b0e672f9") : secret "dns-default-metrics-tls" not found
May 20 20:50:27.986049 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:27.986018    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lzlgx"
May 20 20:50:53.132415 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.132382    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"]
May 20 20:50:53.134144 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.134129    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:50:53.136524 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.136499    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 20 20:50:53.136524 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.136513    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 20 20:50:53.137277 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.137263    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 20 20:50:53.137315 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.137267    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zqz8g\""
May 20 20:50:53.144164 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.144144    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"]
May 20 20:50:53.201144 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.201123    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-ljwqh\" (UID: \"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:50:53.201241 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.201159    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-866lz\" (UniqueName: \"kubernetes.io/projected/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-kube-api-access-866lz\") pod \"cluster-samples-operator-697587599-ljwqh\" (UID: \"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:50:53.233154 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.233132    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-xp8tn"]
May 20 20:50:53.234804 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.234789    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.236827 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.236809    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 20 20:50:53.236949 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.236918    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 20 20:50:53.237009 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.236954    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-t6k7q\""
May 20 20:50:53.237009 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.236964    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 20 20:50:53.237826 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.237809    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 20 20:50:53.242386 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.242367    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 20 20:50:53.248380 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.248361    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-xp8tn"]
May 20 20:50:53.301600 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.301582    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-866lz\" (UniqueName: \"kubernetes.io/projected/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-kube-api-access-866lz\") pod \"cluster-samples-operator-697587599-ljwqh\" (UID: \"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:50:53.301691 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.301613    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-tmp\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.301691 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.301629    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqpf4\" (UniqueName: \"kubernetes.io/projected/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-kube-api-access-vqpf4\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.301759 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.301692    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.301759 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.301723    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-service-ca-bundle\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.301823 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.301774    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-serving-cert\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.301823 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.301794    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-ljwqh\" (UID: \"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:50:53.301823 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.301809    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-snapshots\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.301916 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:53.301876    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 20:50:53.301949 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:53.301936    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls podName:e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a nodeName:}" failed. No retries permitted until 2026-05-20 20:50:53.801921489 +0000 UTC m=+126.731518205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls") pod "cluster-samples-operator-697587599-ljwqh" (UID: "e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a") : secret "samples-operator-tls" not found
May 20 20:50:53.310916 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.310898    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-866lz\" (UniqueName: \"kubernetes.io/projected/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-kube-api-access-866lz\") pod \"cluster-samples-operator-697587599-ljwqh\" (UID: \"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:50:53.332928 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.332900    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bd77c4d94-5l8ck"]
May 20 20:50:53.334731 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.334714    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.337535 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.337519    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 20 20:50:53.337786 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.337774    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 20 20:50:53.337937 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.337921    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gppll\""
May 20 20:50:53.337997 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.337982    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 20 20:50:53.338037 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.337994    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 20 20:50:53.338087 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.338040    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 20 20:50:53.338551 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.338537    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 20 20:50:53.347610 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.347590    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bd77c4d94-5l8ck"]
May 20 20:50:53.403054 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403022    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-serving-cert\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.403146 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403068    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.403214 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403194    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-snapshots\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.403265 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403237    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.403265 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403255    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-stats-auth\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.403361 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403286    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-tmp\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.403361 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403311    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqpf4\" (UniqueName: \"kubernetes.io/projected/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-kube-api-access-vqpf4\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.403361 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403328    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-default-certificate\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.403673 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403375    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.403673 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403399    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-service-ca-bundle\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.403673 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403420    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx4sx\" (UniqueName: \"kubernetes.io/projected/f4402bc2-97c9-4867-8e96-4938d325a1fa-kube-api-access-gx4sx\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.403930 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403909    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-snapshots\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.403930 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403916    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-tmp\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.404031 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.403978    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-service-ca-bundle\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.404171 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.404152    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.405258 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.405240    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-serving-cert\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.412552 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.412533    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqpf4\" (UniqueName: \"kubernetes.io/projected/ed3815d4-6e62-48d0-93c5-cd5e306c1b5d-kube-api-access-vqpf4\") pod \"insights-operator-78bdfb888c-xp8tn\" (UID: \"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d\") " pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.504001 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.503967    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gx4sx\" (UniqueName: \"kubernetes.io/projected/f4402bc2-97c9-4867-8e96-4938d325a1fa-kube-api-access-gx4sx\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.504119 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.504014    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.504119 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.504063    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.504119 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.504090    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-stats-auth\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.504273 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.504122    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-default-certificate\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.504273 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:53.504190    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 20:50:53.504273 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:53.504224    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle podName:f4402bc2-97c9-4867-8e96-4938d325a1fa nodeName:}" failed. No retries permitted until 2026-05-20 20:50:54.004204698 +0000 UTC m=+126.933801441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle") pod "router-default-6bd77c4d94-5l8ck" (UID: "f4402bc2-97c9-4867-8e96-4938d325a1fa") : configmap references non-existent config key: service-ca.crt
May 20 20:50:53.504273 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:53.504262    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs podName:f4402bc2-97c9-4867-8e96-4938d325a1fa nodeName:}" failed. No retries permitted until 2026-05-20 20:50:54.004244539 +0000 UTC m=+126.933841279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs") pod "router-default-6bd77c4d94-5l8ck" (UID: "f4402bc2-97c9-4867-8e96-4938d325a1fa") : secret "router-metrics-certs-default" not found
May 20 20:50:53.506294 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.506271    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-default-certificate\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.506371 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.506298    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-stats-auth\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.515142 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.515123    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx4sx\" (UniqueName: \"kubernetes.io/projected/f4402bc2-97c9-4867-8e96-4938d325a1fa-kube-api-access-gx4sx\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:53.543756 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.543737    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-xp8tn"
May 20 20:50:53.655676 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.655609    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-xp8tn"]
May 20 20:50:53.658701 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:50:53.658675    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3815d4_6e62_48d0_93c5_cd5e306c1b5d.slice/crio-be502c5d11d17e096040c9e25274821e3c4289ef553130f74a118f6886239427 WatchSource:0}: Error finding container be502c5d11d17e096040c9e25274821e3c4289ef553130f74a118f6886239427: Status 404 returned error can't find the container with id be502c5d11d17e096040c9e25274821e3c4289ef553130f74a118f6886239427
May 20 20:50:53.806270 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:53.806235    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-ljwqh\" (UID: \"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:50:53.806398 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:53.806374    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 20:50:53.806471 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:53.806460    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls podName:e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a nodeName:}" failed. No retries permitted until 2026-05-20 20:50:54.806427225 +0000 UTC m=+127.736023941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls") pod "cluster-samples-operator-697587599-ljwqh" (UID: "e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a") : secret "samples-operator-tls" not found
May 20 20:50:54.007737 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.007663    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:54.007737 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.007725    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:54.007932 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:54.007800    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 20:50:54.007932 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:54.007858    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs podName:f4402bc2-97c9-4867-8e96-4938d325a1fa nodeName:}" failed. No retries permitted until 2026-05-20 20:50:55.007840779 +0000 UTC m=+127.937437513 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs") pod "router-default-6bd77c4d94-5l8ck" (UID: "f4402bc2-97c9-4867-8e96-4938d325a1fa") : secret "router-metrics-certs-default" not found
May 20 20:50:54.007932 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:54.007871    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle podName:f4402bc2-97c9-4867-8e96-4938d325a1fa nodeName:}" failed. No retries permitted until 2026-05-20 20:50:55.007865436 +0000 UTC m=+127.937462152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle") pod "router-default-6bd77c4d94-5l8ck" (UID: "f4402bc2-97c9-4867-8e96-4938d325a1fa") : configmap references non-existent config key: service-ca.crt
May 20 20:50:54.092315 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.092280    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xp8tn" event={"ID":"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d","Type":"ContainerStarted","Data":"be502c5d11d17e096040c9e25274821e3c4289ef553130f74a118f6886239427"}
May 20 20:50:54.140121 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.140093    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"]
May 20 20:50:54.142866 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.142851    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"
May 20 20:50:54.145311 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.145283    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 20 20:50:54.145504 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.145487    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 20 20:50:54.145583 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.145540    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 20 20:50:54.145651 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.145544    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 20 20:50:54.145651 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.145629    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-57wbm\""
May 20 20:50:54.152013 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.151990    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"]
May 20 20:50:54.209797 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.209772    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6fe8a3e-de98-45ea-93e8-13d47fbb14ec-serving-cert\") pod \"service-ca-operator-57b5b68b8-qqbh7\" (UID: \"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"
May 20 20:50:54.209922 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.209801    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6fe8a3e-de98-45ea-93e8-13d47fbb14ec-config\") pod \"service-ca-operator-57b5b68b8-qqbh7\" (UID: \"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"
May 20 20:50:54.209922 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.209839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th8kr\" (UniqueName: \"kubernetes.io/projected/e6fe8a3e-de98-45ea-93e8-13d47fbb14ec-kube-api-access-th8kr\") pod \"service-ca-operator-57b5b68b8-qqbh7\" (UID: \"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"
May 20 20:50:54.310461 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.310392    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6fe8a3e-de98-45ea-93e8-13d47fbb14ec-serving-cert\") pod \"service-ca-operator-57b5b68b8-qqbh7\" (UID: \"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"
May 20 20:50:54.310461 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.310426    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6fe8a3e-de98-45ea-93e8-13d47fbb14ec-config\") pod \"service-ca-operator-57b5b68b8-qqbh7\" (UID: \"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"
May 20 20:50:54.310783 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.310631    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-th8kr\" (UniqueName: \"kubernetes.io/projected/e6fe8a3e-de98-45ea-93e8-13d47fbb14ec-kube-api-access-th8kr\") pod \"service-ca-operator-57b5b68b8-qqbh7\" (UID: \"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"
May 20 20:50:54.311008 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.310987    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6fe8a3e-de98-45ea-93e8-13d47fbb14ec-config\") pod \"service-ca-operator-57b5b68b8-qqbh7\" (UID: \"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"
May 20 20:50:54.313354 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.313330    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6fe8a3e-de98-45ea-93e8-13d47fbb14ec-serving-cert\") pod \"service-ca-operator-57b5b68b8-qqbh7\" (UID: \"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"
May 20 20:50:54.320420 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.320390    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th8kr\" (UniqueName: \"kubernetes.io/projected/e6fe8a3e-de98-45ea-93e8-13d47fbb14ec-kube-api-access-th8kr\") pod \"service-ca-operator-57b5b68b8-qqbh7\" (UID: \"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"
May 20 20:50:54.451916 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.451888    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"
May 20 20:50:54.576796 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.576728    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7"]
May 20 20:50:54.579921 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:50:54.579894    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6fe8a3e_de98_45ea_93e8_13d47fbb14ec.slice/crio-b7d5badefc959097f8e6c08d820783f246393e1639eed1448e9cc74ac3826d10 WatchSource:0}: Error finding container b7d5badefc959097f8e6c08d820783f246393e1639eed1448e9cc74ac3826d10: Status 404 returned error can't find the container with id b7d5badefc959097f8e6c08d820783f246393e1639eed1448e9cc74ac3826d10
May 20 20:50:54.815338 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:54.815308    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-ljwqh\" (UID: \"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:50:54.815534 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:54.815494    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 20:50:54.815596 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:54.815568    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls podName:e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a nodeName:}" failed. No retries permitted until 2026-05-20 20:50:56.815546556 +0000 UTC m=+129.745143285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls") pod "cluster-samples-operator-697587599-ljwqh" (UID: "e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a") : secret "samples-operator-tls" not found
May 20 20:50:55.017373 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:55.017326    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:55.017590 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:55.017407    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:55.017590 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:55.017482    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 20:50:55.017590 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:55.017553    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs podName:f4402bc2-97c9-4867-8e96-4938d325a1fa nodeName:}" failed. No retries permitted until 2026-05-20 20:50:57.017537334 +0000 UTC m=+129.947134076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs") pod "router-default-6bd77c4d94-5l8ck" (UID: "f4402bc2-97c9-4867-8e96-4938d325a1fa") : secret "router-metrics-certs-default" not found
May 20 20:50:55.017590 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:55.017570    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle podName:f4402bc2-97c9-4867-8e96-4938d325a1fa nodeName:}" failed. No retries permitted until 2026-05-20 20:50:57.017563882 +0000 UTC m=+129.947160599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle") pod "router-default-6bd77c4d94-5l8ck" (UID: "f4402bc2-97c9-4867-8e96-4938d325a1fa") : configmap references non-existent config key: service-ca.crt
May 20 20:50:55.095646 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:55.095615    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7" event={"ID":"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec","Type":"ContainerStarted","Data":"b7d5badefc959097f8e6c08d820783f246393e1639eed1448e9cc74ac3826d10"}
May 20 20:50:56.099302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:56.099210    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xp8tn" event={"ID":"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d","Type":"ContainerStarted","Data":"0886b14e2ec40635271dfe4ac611f4ad000ba87940a509e5aaae7e745bab1ed8"}
May 20 20:50:56.119903 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:56.119844    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-xp8tn" podStartSLOduration=1.114716485 podStartE2EDuration="3.119826952s" podCreationTimestamp="2026-05-20 20:50:53 +0000 UTC" firstStartedPulling="2026-05-20 20:50:53.660249176 +0000 UTC m=+126.589845894" lastFinishedPulling="2026-05-20 20:50:55.665359634 +0000 UTC m=+128.594956361" observedRunningTime="2026-05-20 20:50:56.118716075 +0000 UTC m=+129.048312815" watchObservedRunningTime="2026-05-20 20:50:56.119826952 +0000 UTC m=+129.049423691"
May 20 20:50:56.833884 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:56.833846    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-ljwqh\" (UID: \"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:50:56.834066 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:56.834008    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 20:50:56.834131 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:56.834089    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls podName:e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a nodeName:}" failed. No retries permitted until 2026-05-20 20:51:00.834068773 +0000 UTC m=+133.763665492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls") pod "cluster-samples-operator-697587599-ljwqh" (UID: "e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a") : secret "samples-operator-tls" not found
May 20 20:50:57.038247 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.038215    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:57.038376 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.038268    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:50:57.038376 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:57.038370    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle podName:f4402bc2-97c9-4867-8e96-4938d325a1fa nodeName:}" failed. No retries permitted until 2026-05-20 20:51:01.038356433 +0000 UTC m=+133.967953162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle") pod "router-default-6bd77c4d94-5l8ck" (UID: "f4402bc2-97c9-4867-8e96-4938d325a1fa") : configmap references non-existent config key: service-ca.crt
May 20 20:50:57.038507 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:57.038384    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 20:50:57.038507 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:57.038465    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs podName:f4402bc2-97c9-4867-8e96-4938d325a1fa nodeName:}" failed. No retries permitted until 2026-05-20 20:51:01.038446516 +0000 UTC m=+133.968043247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs") pod "router-default-6bd77c4d94-5l8ck" (UID: "f4402bc2-97c9-4867-8e96-4938d325a1fa") : secret "router-metrics-certs-default" not found
May 20 20:50:57.102968 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.102934    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7" event={"ID":"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec","Type":"ContainerStarted","Data":"c685e8c6f5a83d862cfe25ce7d4a2afa6c2fdd5bc940ef28cc49e73eae61da33"}
May 20 20:50:57.121044 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.120999    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7" podStartSLOduration=1.110574178 podStartE2EDuration="3.120986495s" podCreationTimestamp="2026-05-20 20:50:54 +0000 UTC" firstStartedPulling="2026-05-20 20:50:54.581659969 +0000 UTC m=+127.511256685" lastFinishedPulling="2026-05-20 20:50:56.592072285 +0000 UTC m=+129.521669002" observedRunningTime="2026-05-20 20:50:57.120273293 +0000 UTC m=+130.049870030" watchObservedRunningTime="2026-05-20 20:50:57.120986495 +0000 UTC m=+130.050583233"
May 20 20:50:57.341825 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.341732    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:50:57.341992 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:57.341844    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 20:50:57.341992 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:50:57.341900    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs podName:f8322035-26e8-42bd-9269-3ba2a2284d96 nodeName:}" failed. No retries permitted until 2026-05-20 20:52:59.341883316 +0000 UTC m=+252.271480047 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs") pod "network-metrics-daemon-xmtnp" (UID: "f8322035-26e8-42bd-9269-3ba2a2284d96") : secret "metrics-daemon-secret" not found
May 20 20:50:57.650292 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.650264    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6"]
May 20 20:50:57.652205 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.652189    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6"
May 20 20:50:57.655483 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.655457    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 20 20:50:57.655603 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.655457    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 20 20:50:57.655904 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.655883    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ch5s5\""
May 20 20:50:57.662203 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.662185    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6"]
May 20 20:50:57.744002 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.743977    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z45m4\" (UniqueName: \"kubernetes.io/projected/8c6e0138-28fd-4958-986a-b548e8a86cdc-kube-api-access-z45m4\") pod \"migrator-b985f5d89-7pds6\" (UID: \"8c6e0138-28fd-4958-986a-b548e8a86cdc\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6"
May 20 20:50:57.844774 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.844748    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z45m4\" (UniqueName: \"kubernetes.io/projected/8c6e0138-28fd-4958-986a-b548e8a86cdc-kube-api-access-z45m4\") pod \"migrator-b985f5d89-7pds6\" (UID: \"8c6e0138-28fd-4958-986a-b548e8a86cdc\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6"
May 20 20:50:57.854770 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.854745    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z45m4\" (UniqueName: \"kubernetes.io/projected/8c6e0138-28fd-4958-986a-b548e8a86cdc-kube-api-access-z45m4\") pod \"migrator-b985f5d89-7pds6\" (UID: \"8c6e0138-28fd-4958-986a-b548e8a86cdc\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6"
May 20 20:50:57.961307 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:57.961244    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6"
May 20 20:50:58.081460 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:58.081413    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6"]
May 20 20:50:58.084729 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:50:58.084702    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6e0138_28fd_4958_986a_b548e8a86cdc.slice/crio-9aaf1c0abf5438accb85e32cef6cd7b54702efae177157ce0630a822d7a11b55 WatchSource:0}: Error finding container 9aaf1c0abf5438accb85e32cef6cd7b54702efae177157ce0630a822d7a11b55: Status 404 returned error can't find the container with id 9aaf1c0abf5438accb85e32cef6cd7b54702efae177157ce0630a822d7a11b55
May 20 20:50:58.105921 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:58.105893    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6" event={"ID":"8c6e0138-28fd-4958-986a-b548e8a86cdc","Type":"ContainerStarted","Data":"9aaf1c0abf5438accb85e32cef6cd7b54702efae177157ce0630a822d7a11b55"}
May 20 20:50:59.108920 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:59.108888    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6" event={"ID":"8c6e0138-28fd-4958-986a-b548e8a86cdc","Type":"ContainerStarted","Data":"d95f5df89739cc2f17a558f7cccdce36a9a22b21f71cb98a1fb417921c0b72c0"}
May 20 20:50:59.109215 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:59.108932    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6" event={"ID":"8c6e0138-28fd-4958-986a-b548e8a86cdc","Type":"ContainerStarted","Data":"f4702ddefa3559bb90411fbb7b68c4ea1473c2e9da91d4553ed2c0aa9e194825"}
May 20 20:50:59.132499 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:59.132454    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7pds6" podStartSLOduration=1.215033435 podStartE2EDuration="2.132421083s" podCreationTimestamp="2026-05-20 20:50:57 +0000 UTC" firstStartedPulling="2026-05-20 20:50:58.08652515 +0000 UTC m=+131.016121870" lastFinishedPulling="2026-05-20 20:50:59.003912801 +0000 UTC m=+131.933509518" observedRunningTime="2026-05-20 20:50:59.131933276 +0000 UTC m=+132.061530016" watchObservedRunningTime="2026-05-20 20:50:59.132421083 +0000 UTC m=+132.062017821"
May 20 20:50:59.325882 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:50:59.325831    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xmllx_bf8a3989-f2f8-4bb7-a1de-9d400bc27a70/dns-node-resolver/0.log"
May 20 20:51:00.326247 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.326216    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7g48h_70a22dd4-17d1-4946-9a36-891f152790aa/node-ca/0.log"
May 20 20:51:00.615092 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.614997    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9wgwt"]
May 20 20:51:00.616998 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.616976    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-9wgwt"
May 20 20:51:00.619468 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.619397    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 20 20:51:00.619921 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.619903    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jnvhg\""
May 20 20:51:00.620176 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.620161    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 20 20:51:00.620290 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.620164    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 20 20:51:00.620337 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.620323    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 20 20:51:00.632257 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.632235    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9wgwt"]
May 20 20:51:00.770135 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.770096    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9481deb6-b705-4c6e-8589-79d81c2f4f02-signing-key\") pod \"service-ca-67d667c7d-9wgwt\" (UID: \"9481deb6-b705-4c6e-8589-79d81c2f4f02\") " pod="openshift-service-ca/service-ca-67d667c7d-9wgwt"
May 20 20:51:00.770265 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.770200    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2rmf\" (UniqueName: \"kubernetes.io/projected/9481deb6-b705-4c6e-8589-79d81c2f4f02-kube-api-access-x2rmf\") pod \"service-ca-67d667c7d-9wgwt\" (UID: \"9481deb6-b705-4c6e-8589-79d81c2f4f02\") " pod="openshift-service-ca/service-ca-67d667c7d-9wgwt"
May 20 20:51:00.770311 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.770277    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9481deb6-b705-4c6e-8589-79d81c2f4f02-signing-cabundle\") pod \"service-ca-67d667c7d-9wgwt\" (UID: \"9481deb6-b705-4c6e-8589-79d81c2f4f02\") " pod="openshift-service-ca/service-ca-67d667c7d-9wgwt"
May 20 20:51:00.871275 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.871219    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9481deb6-b705-4c6e-8589-79d81c2f4f02-signing-key\") pod \"service-ca-67d667c7d-9wgwt\" (UID: \"9481deb6-b705-4c6e-8589-79d81c2f4f02\") " pod="openshift-service-ca/service-ca-67d667c7d-9wgwt"
May 20 20:51:00.871275 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.871271    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2rmf\" (UniqueName: \"kubernetes.io/projected/9481deb6-b705-4c6e-8589-79d81c2f4f02-kube-api-access-x2rmf\") pod \"service-ca-67d667c7d-9wgwt\" (UID: \"9481deb6-b705-4c6e-8589-79d81c2f4f02\") " pod="openshift-service-ca/service-ca-67d667c7d-9wgwt"
May 20 20:51:00.871425 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.871408    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-ljwqh\" (UID: \"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:51:00.871503 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.871481    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9481deb6-b705-4c6e-8589-79d81c2f4f02-signing-cabundle\") pod \"service-ca-67d667c7d-9wgwt\" (UID: \"9481deb6-b705-4c6e-8589-79d81c2f4f02\") " pod="openshift-service-ca/service-ca-67d667c7d-9wgwt"
May 20 20:51:00.871548 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:00.871533    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 20:51:00.871600 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:00.871590    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls podName:e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a nodeName:}" failed. No retries permitted until 2026-05-20 20:51:08.871572482 +0000 UTC m=+141.801169224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls") pod "cluster-samples-operator-697587599-ljwqh" (UID: "e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a") : secret "samples-operator-tls" not found
May 20 20:51:00.872064 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.872045    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9481deb6-b705-4c6e-8589-79d81c2f4f02-signing-cabundle\") pod \"service-ca-67d667c7d-9wgwt\" (UID: \"9481deb6-b705-4c6e-8589-79d81c2f4f02\") " pod="openshift-service-ca/service-ca-67d667c7d-9wgwt"
May 20 20:51:00.873566 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.873541    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9481deb6-b705-4c6e-8589-79d81c2f4f02-signing-key\") pod \"service-ca-67d667c7d-9wgwt\" (UID: \"9481deb6-b705-4c6e-8589-79d81c2f4f02\") " pod="openshift-service-ca/service-ca-67d667c7d-9wgwt"
May 20 20:51:00.880763 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.880741    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2rmf\" (UniqueName: \"kubernetes.io/projected/9481deb6-b705-4c6e-8589-79d81c2f4f02-kube-api-access-x2rmf\") pod \"service-ca-67d667c7d-9wgwt\" (UID: \"9481deb6-b705-4c6e-8589-79d81c2f4f02\") " pod="openshift-service-ca/service-ca-67d667c7d-9wgwt"
May 20 20:51:00.926425 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:00.926401    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-9wgwt"
May 20 20:51:01.049717 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:01.049682    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-9wgwt"]
May 20 20:51:01.052823 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:01.052795    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9481deb6_b705_4c6e_8589_79d81c2f4f02.slice/crio-c0b0c764b433aba034b9eacc9c227140a3300c6837a97cdd336d088cb6bb30bc WatchSource:0}: Error finding container c0b0c764b433aba034b9eacc9c227140a3300c6837a97cdd336d088cb6bb30bc: Status 404 returned error can't find the container with id c0b0c764b433aba034b9eacc9c227140a3300c6837a97cdd336d088cb6bb30bc
May 20 20:51:01.072858 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:01.072835    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:51:01.072939 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:01.072905    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:51:01.073013 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:01.073000    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle podName:f4402bc2-97c9-4867-8e96-4938d325a1fa nodeName:}" failed. No retries permitted until 2026-05-20 20:51:09.072984597 +0000 UTC m=+142.002581317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle") pod "router-default-6bd77c4d94-5l8ck" (UID: "f4402bc2-97c9-4867-8e96-4938d325a1fa") : configmap references non-existent config key: service-ca.crt
May 20 20:51:01.073066 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:01.073020    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 20 20:51:01.073102 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:01.073074    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs podName:f4402bc2-97c9-4867-8e96-4938d325a1fa nodeName:}" failed. No retries permitted until 2026-05-20 20:51:09.073059332 +0000 UTC m=+142.002656073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs") pod "router-default-6bd77c4d94-5l8ck" (UID: "f4402bc2-97c9-4867-8e96-4938d325a1fa") : secret "router-metrics-certs-default" not found
May 20 20:51:01.115004 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:01.114969    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-9wgwt" event={"ID":"9481deb6-b705-4c6e-8589-79d81c2f4f02","Type":"ContainerStarted","Data":"1bc5a714ffc4353e65a58057ccae4dc86083106b83913cad6df39e7a353e9b85"}
May 20 20:51:01.115087 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:01.115008    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-9wgwt" event={"ID":"9481deb6-b705-4c6e-8589-79d81c2f4f02","Type":"ContainerStarted","Data":"c0b0c764b433aba034b9eacc9c227140a3300c6837a97cdd336d088cb6bb30bc"}
May 20 20:51:01.134344 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:01.134242    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-9wgwt" podStartSLOduration=1.134228594 podStartE2EDuration="1.134228594s" podCreationTimestamp="2026-05-20 20:51:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:51:01.13383804 +0000 UTC m=+134.063434780" watchObservedRunningTime="2026-05-20 20:51:01.134228594 +0000 UTC m=+134.063825333"
May 20 20:51:08.931636 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:08.931598    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-ljwqh\" (UID: \"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:51:08.934026 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:08.933999    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-ljwqh\" (UID: \"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:51:09.043141 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:09.043099    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"
May 20 20:51:09.132957 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:09.132929    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:51:09.133078 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:09.132975    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:51:09.133682 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:09.133658    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4402bc2-97c9-4867-8e96-4938d325a1fa-service-ca-bundle\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:51:09.135478 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:09.135457    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4402bc2-97c9-4867-8e96-4938d325a1fa-metrics-certs\") pod \"router-default-6bd77c4d94-5l8ck\" (UID: \"f4402bc2-97c9-4867-8e96-4938d325a1fa\") " pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:51:09.168307 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:09.168283    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh"]
May 20 20:51:09.242787 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:09.242759    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:51:09.368484 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:09.368452    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bd77c4d94-5l8ck"]
May 20 20:51:09.372682 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:09.372654    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4402bc2_97c9_4867_8e96_4938d325a1fa.slice/crio-d08fd90c9a3cf323cb725a576caa455d2baeacfd6c9e2c8e8ed5bbae5ea096de WatchSource:0}: Error finding container d08fd90c9a3cf323cb725a576caa455d2baeacfd6c9e2c8e8ed5bbae5ea096de: Status 404 returned error can't find the container with id d08fd90c9a3cf323cb725a576caa455d2baeacfd6c9e2c8e8ed5bbae5ea096de
May 20 20:51:10.140696 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:10.140656    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bd77c4d94-5l8ck" event={"ID":"f4402bc2-97c9-4867-8e96-4938d325a1fa","Type":"ContainerStarted","Data":"f4a2182b39364eaf9bebea2a723118991e27f11ef45a313967143536ab153464"}
May 20 20:51:10.140696 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:10.140706    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bd77c4d94-5l8ck" event={"ID":"f4402bc2-97c9-4867-8e96-4938d325a1fa","Type":"ContainerStarted","Data":"d08fd90c9a3cf323cb725a576caa455d2baeacfd6c9e2c8e8ed5bbae5ea096de"}
May 20 20:51:10.142032 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:10.142002    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh" event={"ID":"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a","Type":"ContainerStarted","Data":"1569d3d23721885553a7ae838b761f5cd64cd65d884895b227af8376bd8c9424"}
May 20 20:51:10.164125 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:10.164077    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6bd77c4d94-5l8ck" podStartSLOduration=17.164063827 podStartE2EDuration="17.164063827s" podCreationTimestamp="2026-05-20 20:50:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:51:10.162989245 +0000 UTC m=+143.092585986" watchObservedRunningTime="2026-05-20 20:51:10.164063827 +0000 UTC m=+143.093660566"
May 20 20:51:10.243721 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:10.243693    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:51:10.246352 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:10.246323    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:51:11.147515 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:11.147473    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh" event={"ID":"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a","Type":"ContainerStarted","Data":"f308b8b25cca535d5b6dd1760dfdf245bcc5bd38ea3ccded42148a33aeea24ed"}
May 20 20:51:11.147967 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:11.147522    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh" event={"ID":"e40bfce6-b374-4dfc-aa26-55ff4f9d1e5a","Type":"ContainerStarted","Data":"cebef0573210bfe5fe75d42af07e0830fa99fb9b84c15a1f29d0faa4294c69a7"}
May 20 20:51:11.147967 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:11.147797    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:51:11.149002 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:11.148978    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bd77c4d94-5l8ck"
May 20 20:51:11.169296 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:11.169254    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-ljwqh" podStartSLOduration=16.703165631 podStartE2EDuration="18.169242289s" podCreationTimestamp="2026-05-20 20:50:53 +0000 UTC" firstStartedPulling="2026-05-20 20:51:09.209730402 +0000 UTC m=+142.139327118" lastFinishedPulling="2026-05-20 20:51:10.675807055 +0000 UTC m=+143.605403776" observedRunningTime="2026-05-20 20:51:11.169133665 +0000 UTC m=+144.098730404" watchObservedRunningTime="2026-05-20 20:51:11.169242289 +0000 UTC m=+144.098839028"
May 20 20:51:22.583209 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.583179    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8l6gm"]
May 20 20:51:22.585238 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.585222    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.587428 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.587408    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 20 20:51:22.588578 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.588556    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f7g46\""
May 20 20:51:22.588676 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.588580    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 20 20:51:22.599131 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.599109    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8l6gm"]
May 20 20:51:22.728272 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.728235    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c597892d-533a-4fc1-8c44-7a04062a046f-data-volume\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.728460 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.728301    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c597892d-533a-4fc1-8c44-7a04062a046f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.728460 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.728354    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f967w\" (UniqueName: \"kubernetes.io/projected/c597892d-533a-4fc1-8c44-7a04062a046f-kube-api-access-f967w\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.728460 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.728413    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c597892d-533a-4fc1-8c44-7a04062a046f-crio-socket\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.728565 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.728475    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c597892d-533a-4fc1-8c44-7a04062a046f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.829635 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.829551    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f967w\" (UniqueName: \"kubernetes.io/projected/c597892d-533a-4fc1-8c44-7a04062a046f-kube-api-access-f967w\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.829635 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.829589    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c597892d-533a-4fc1-8c44-7a04062a046f-crio-socket\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.829635 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.829624    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c597892d-533a-4fc1-8c44-7a04062a046f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.829939 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.829667    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c597892d-533a-4fc1-8c44-7a04062a046f-data-volume\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.829939 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.829692    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c597892d-533a-4fc1-8c44-7a04062a046f-crio-socket\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.829939 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.829719    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c597892d-533a-4fc1-8c44-7a04062a046f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.830145 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.830122    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c597892d-533a-4fc1-8c44-7a04062a046f-data-volume\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.830336 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.830320    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c597892d-533a-4fc1-8c44-7a04062a046f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.832108 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.832088    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c597892d-533a-4fc1-8c44-7a04062a046f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.840551 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.840524    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f967w\" (UniqueName: \"kubernetes.io/projected/c597892d-533a-4fc1-8c44-7a04062a046f-kube-api-access-f967w\") pod \"insights-runtime-extractor-8l6gm\" (UID: \"c597892d-533a-4fc1-8c44-7a04062a046f\") " pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:22.894642 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:22.894617    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8l6gm"
May 20 20:51:23.019679 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:23.019650    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8l6gm"]
May 20 20:51:23.023181 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:23.023154    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc597892d_533a_4fc1_8c44_7a04062a046f.slice/crio-47a08185f13eece5793fac518314b504f05c75efbba008d02a9517febf933caf WatchSource:0}: Error finding container 47a08185f13eece5793fac518314b504f05c75efbba008d02a9517febf933caf: Status 404 returned error can't find the container with id 47a08185f13eece5793fac518314b504f05c75efbba008d02a9517febf933caf
May 20 20:51:23.180424 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:23.180390    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8l6gm" event={"ID":"c597892d-533a-4fc1-8c44-7a04062a046f","Type":"ContainerStarted","Data":"d5f768fb123931bbe33bad220d0d66af097961a8c770f628c5e69bbea9c34884"}
May 20 20:51:23.180424 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:23.180425    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8l6gm" event={"ID":"c597892d-533a-4fc1-8c44-7a04062a046f","Type":"ContainerStarted","Data":"47a08185f13eece5793fac518314b504f05c75efbba008d02a9517febf933caf"}
May 20 20:51:24.184492 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:24.184458    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8l6gm" event={"ID":"c597892d-533a-4fc1-8c44-7a04062a046f","Type":"ContainerStarted","Data":"778be56d158ed853cde6229069ef03f60886071693b8aa2ea3b46b8f8faf3afa"}
May 20 20:51:25.188928 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:25.188895    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8l6gm" event={"ID":"c597892d-533a-4fc1-8c44-7a04062a046f","Type":"ContainerStarted","Data":"c863b240c59dd58d871915e229e560a3cdf0a66a38e3d8bded5cd10ab5f2e33b"}
May 20 20:51:25.211042 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:25.211002    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8l6gm" podStartSLOduration=1.294905602 podStartE2EDuration="3.210989286s" podCreationTimestamp="2026-05-20 20:51:22 +0000 UTC" firstStartedPulling="2026-05-20 20:51:23.076884698 +0000 UTC m=+156.006481415" lastFinishedPulling="2026-05-20 20:51:24.992968377 +0000 UTC m=+157.922565099" observedRunningTime="2026-05-20 20:51:25.210049509 +0000 UTC m=+158.139646248" watchObservedRunningTime="2026-05-20 20:51:25.210989286 +0000 UTC m=+158.140586024"
May 20 20:51:25.504877 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:25.504850    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9vj5g" podUID="816319b6-b54d-45b8-8bdb-1f75b0e672f9"
May 20 20:51:25.527149 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:25.527117    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-h2df2" podUID="48b7525a-3a26-423d-9eb2-64ea2179f1d3"
May 20 20:51:26.191804 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:26.191769    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vj5g"
May 20 20:51:26.682818 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:26.682783    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xmtnp" podUID="f8322035-26e8-42bd-9269-3ba2a2284d96"
May 20 20:51:27.785101 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:27.785070    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws"]
May 20 20:51:27.787105 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:27.787081    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws"
May 20 20:51:27.789370 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:27.789348    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 20 20:51:27.789495 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:27.789350    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pls9g\""
May 20 20:51:27.795786 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:27.795763    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws"]
May 20 20:51:27.870103 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:27.870075    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ddd98270-e4ae-418e-ab09-44c6eb96d51e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-kpbws\" (UID: \"ddd98270-e4ae-418e-ab09-44c6eb96d51e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws"
May 20 20:51:27.970672 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:27.970652    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ddd98270-e4ae-418e-ab09-44c6eb96d51e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-kpbws\" (UID: \"ddd98270-e4ae-418e-ab09-44c6eb96d51e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws"
May 20 20:51:27.970798 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:27.970783    2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 20 20:51:27.970847 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:27.970838    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd98270-e4ae-418e-ab09-44c6eb96d51e-tls-certificates podName:ddd98270-e4ae-418e-ab09-44c6eb96d51e nodeName:}" failed. No retries permitted until 2026-05-20 20:51:28.470823853 +0000 UTC m=+161.400420570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ddd98270-e4ae-418e-ab09-44c6eb96d51e-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-kpbws" (UID: "ddd98270-e4ae-418e-ab09-44c6eb96d51e") : secret "prometheus-operator-admission-webhook-tls" not found
May 20 20:51:28.474998 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:28.474966    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ddd98270-e4ae-418e-ab09-44c6eb96d51e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-kpbws\" (UID: \"ddd98270-e4ae-418e-ab09-44c6eb96d51e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws"
May 20 20:51:28.477302 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:28.477271    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ddd98270-e4ae-418e-ab09-44c6eb96d51e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-kpbws\" (UID: \"ddd98270-e4ae-418e-ab09-44c6eb96d51e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws"
May 20 20:51:28.696327 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:28.696279    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws"
May 20 20:51:28.831890 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:28.831777    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws"]
May 20 20:51:28.834465 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:28.834407    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd98270_e4ae_418e_ab09_44c6eb96d51e.slice/crio-31636686eebce51d485d0ba7b573c05472e7f69b1521dc9b62e75bfb998a4d96 WatchSource:0}: Error finding container 31636686eebce51d485d0ba7b573c05472e7f69b1521dc9b62e75bfb998a4d96: Status 404 returned error can't find the container with id 31636686eebce51d485d0ba7b573c05472e7f69b1521dc9b62e75bfb998a4d96
May 20 20:51:29.199710 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:29.199673    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws" event={"ID":"ddd98270-e4ae-418e-ab09-44c6eb96d51e","Type":"ContainerStarted","Data":"31636686eebce51d485d0ba7b573c05472e7f69b1521dc9b62e75bfb998a4d96"}
May 20 20:51:30.207754 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:30.207713    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws" event={"ID":"ddd98270-e4ae-418e-ab09-44c6eb96d51e","Type":"ContainerStarted","Data":"d4dea3b5dd9a85bc073ac0378b7d9367c4b16311ade6fd284c4caa7050cc9eb4"}
May 20 20:51:30.208173 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:30.207935    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws"
May 20 20:51:30.212504 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:30.212475    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws"
May 20 20:51:30.227766 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:30.227728    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-kpbws" podStartSLOduration=1.979028713 podStartE2EDuration="3.227716762s" podCreationTimestamp="2026-05-20 20:51:27 +0000 UTC" firstStartedPulling="2026-05-20 20:51:28.836368031 +0000 UTC m=+161.765964748" lastFinishedPulling="2026-05-20 20:51:30.08505608 +0000 UTC m=+163.014652797" observedRunningTime="2026-05-20 20:51:30.226789008 +0000 UTC m=+163.156385748" watchObservedRunningTime="2026-05-20 20:51:30.227716762 +0000 UTC m=+163.157313501"
May 20 20:51:30.389343 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:30.389317    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:51:30.389542 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:30.389356    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:51:30.391687 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:30.391655    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/816319b6-b54d-45b8-8bdb-1f75b0e672f9-metrics-tls\") pod \"dns-default-9vj5g\" (UID: \"816319b6-b54d-45b8-8bdb-1f75b0e672f9\") " pod="openshift-dns/dns-default-9vj5g"
May 20 20:51:30.391819 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:30.391798    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7525a-3a26-423d-9eb2-64ea2179f1d3-cert\") pod \"ingress-canary-h2df2\" (UID: \"48b7525a-3a26-423d-9eb2-64ea2179f1d3\") " pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:51:30.394998 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:30.394980    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c2cd4\""
May 20 20:51:30.403020 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:30.403003    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vj5g"
May 20 20:51:30.520701 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:30.520558    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9vj5g"]
May 20 20:51:30.522978 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:30.522944    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816319b6_b54d_45b8_8bdb_1f75b0e672f9.slice/crio-156bc993a2be44851a6bc3e78729b54aa0fd190aef43fd15d104e93ddb4affb4 WatchSource:0}: Error finding container 156bc993a2be44851a6bc3e78729b54aa0fd190aef43fd15d104e93ddb4affb4: Status 404 returned error can't find the container with id 156bc993a2be44851a6bc3e78729b54aa0fd190aef43fd15d104e93ddb4affb4
May 20 20:51:31.211575 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:31.211539    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vj5g" event={"ID":"816319b6-b54d-45b8-8bdb-1f75b0e672f9","Type":"ContainerStarted","Data":"156bc993a2be44851a6bc3e78729b54aa0fd190aef43fd15d104e93ddb4affb4"}
May 20 20:51:32.215352 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:32.215316    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vj5g" event={"ID":"816319b6-b54d-45b8-8bdb-1f75b0e672f9","Type":"ContainerStarted","Data":"cf2657e127d905756fc17dbdd7feaa1d0f767f2d9ab213def5076e6baf2660f5"}
May 20 20:51:32.215352 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:32.215352    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vj5g" event={"ID":"816319b6-b54d-45b8-8bdb-1f75b0e672f9","Type":"ContainerStarted","Data":"f8d772727958ddfd4e7cf03429885fc23dfbd4a603336b031ae4d327340bab9b"}
May 20 20:51:32.237350 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:32.237301    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-9vj5g" podStartSLOduration=129.08187291 podStartE2EDuration="2m10.237286928s" podCreationTimestamp="2026-05-20 20:49:22 +0000 UTC" firstStartedPulling="2026-05-20 20:51:30.524815577 +0000 UTC m=+163.454412294" lastFinishedPulling="2026-05-20 20:51:31.680229596 +0000 UTC m=+164.609826312" observedRunningTime="2026-05-20 20:51:32.236139164 +0000 UTC m=+165.165735902" watchObservedRunningTime="2026-05-20 20:51:32.237286928 +0000 UTC m=+165.166883667"
May 20 20:51:33.218263 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:33.218235    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9vj5g"
May 20 20:51:35.671002 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:35.670968    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:51:35.673877 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:35.673854    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5vsdg\""
May 20 20:51:35.681930 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:35.681911    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h2df2"
May 20 20:51:35.806093 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:35.806064    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h2df2"]
May 20 20:51:35.810267 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:35.810238    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b7525a_3a26_423d_9eb2_64ea2179f1d3.slice/crio-f401e8e800885fc8e6e007544e1c5bdadd23a5c1eb5b55c85ad6b62edf1094b7 WatchSource:0}: Error finding container f401e8e800885fc8e6e007544e1c5bdadd23a5c1eb5b55c85ad6b62edf1094b7: Status 404 returned error can't find the container with id f401e8e800885fc8e6e007544e1c5bdadd23a5c1eb5b55c85ad6b62edf1094b7
May 20 20:51:36.225489 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:36.225453    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h2df2" event={"ID":"48b7525a-3a26-423d-9eb2-64ea2179f1d3","Type":"ContainerStarted","Data":"f401e8e800885fc8e6e007544e1c5bdadd23a5c1eb5b55c85ad6b62edf1094b7"}
May 20 20:51:38.232310 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:38.232269    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h2df2" event={"ID":"48b7525a-3a26-423d-9eb2-64ea2179f1d3","Type":"ContainerStarted","Data":"e8df9ab06d8568b62cd616f51917ec4d7337b92d4b3b362c5817f05f588ff041"}
May 20 20:51:38.252088 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:38.252042    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h2df2" podStartSLOduration=134.55494778 podStartE2EDuration="2m16.252028592s" podCreationTimestamp="2026-05-20 20:49:22 +0000 UTC" firstStartedPulling="2026-05-20 20:51:35.812464366 +0000 UTC m=+168.742061083" lastFinishedPulling="2026-05-20 20:51:37.509545175 +0000 UTC m=+170.439141895" observedRunningTime="2026-05-20 20:51:38.250856299 +0000 UTC m=+171.180453038" watchObservedRunningTime="2026-05-20 20:51:38.252028592 +0000 UTC m=+171.181625330"
May 20 20:51:40.670516 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:40.670486    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:51:43.223793 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.223754    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9vj5g"
May 20 20:51:43.224717 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.224691    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"]
May 20 20:51:43.227989 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.227967    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"]
May 20 20:51:43.228148 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.228129    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.234005 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.233966    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.237163 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.237132    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 20 20:51:43.237504 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.237484    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q8jfm\""
May 20 20:51:43.237654 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.237634    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 20 20:51:43.237847 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.237799    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 20 20:51:43.237937 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.237920    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 20 20:51:43.238474 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.238456    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 20 20:51:43.238607 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.238531    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 20 20:51:43.239584 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.239565    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"]
May 20 20:51:43.241942 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.241923    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 20 20:51:43.244596 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.244578    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-s9dtk\""
May 20 20:51:43.245162 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.244720    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 20 20:51:43.255019 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.254998    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"]
May 20 20:51:43.262282 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.262256    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wr6b6"]
May 20 20:51:43.265002 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.264978    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.268539 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.267234    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 20 20:51:43.268539 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.267460    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 20 20:51:43.268539 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.267523    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wjlh8\""
May 20 20:51:43.268539 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.267855    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 20 20:51:43.279708 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.279682    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa953017-fcf7-43f2-a33b-a3697bcc01f2-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.279917 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.279895    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.280072 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.280053    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.280203 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.280185    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed0cba94-3573-4887-86a5-32d8c4c47963-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.280346 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.280329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed0cba94-3573-4887-86a5-32d8c4c47963-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.280525 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.280507    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhhb2\" (UniqueName: \"kubernetes.io/projected/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-api-access-jhhb2\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.280672 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.280658    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjbpx\" (UniqueName: \"kubernetes.io/projected/ed0cba94-3573-4887-86a5-32d8c4c47963-kube-api-access-hjbpx\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.280822 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.280806    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fa953017-fcf7-43f2-a33b-a3697bcc01f2-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.280941 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.280926    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0cba94-3573-4887-86a5-32d8c4c47963-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.281073 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.281058    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.381957 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.381922    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjbpx\" (UniqueName: \"kubernetes.io/projected/ed0cba94-3573-4887-86a5-32d8c4c47963-kube-api-access-hjbpx\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.382151 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.381965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4d473dd5-f422-4e9d-af0a-b0cd61270c76-root\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.382151 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.381994    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fa953017-fcf7-43f2-a33b-a3697bcc01f2-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.382151 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382017    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0cba94-3573-4887-86a5-32d8c4c47963-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.382151 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382084    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.382151 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382140    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa953017-fcf7-43f2-a33b-a3697bcc01f2-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.382446 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382172    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.382446 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382203    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-tls\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.382558 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382479    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fa953017-fcf7-43f2-a33b-a3697bcc01f2-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.382739 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382696    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-accelerators-collector-config\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.382874 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382754    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.382874 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382775    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa953017-fcf7-43f2-a33b-a3697bcc01f2-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.382874 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382790    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed0cba94-3573-4887-86a5-32d8c4c47963-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.382874 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382835    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed0cba94-3573-4887-86a5-32d8c4c47963-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.382874 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382863    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d473dd5-f422-4e9d-af0a-b0cd61270c76-sys\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.383147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382899    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-wtmp\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.383147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382940    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhhb2\" (UniqueName: \"kubernetes.io/projected/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-api-access-jhhb2\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.383147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.382977    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nghf5\" (UniqueName: \"kubernetes.io/projected/4d473dd5-f422-4e9d-af0a-b0cd61270c76-kube-api-access-nghf5\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.383147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.383037    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-textfile\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.383147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.383074    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d473dd5-f422-4e9d-af0a-b0cd61270c76-metrics-client-ca\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.383147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.383114    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.384115 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.384086    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed0cba94-3573-4887-86a5-32d8c4c47963-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.384213 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.384085    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.385062 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.385037    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.385152 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.385137    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed0cba94-3573-4887-86a5-32d8c4c47963-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.385413 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.385393    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed0cba94-3573-4887-86a5-32d8c4c47963-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.385939 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.385851    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.390672 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.390647    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjbpx\" (UniqueName: \"kubernetes.io/projected/ed0cba94-3573-4887-86a5-32d8c4c47963-kube-api-access-hjbpx\") pod \"openshift-state-metrics-9c959559f-flvpm\" (UID: \"ed0cba94-3573-4887-86a5-32d8c4c47963\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.392745 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.392713    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhhb2\" (UniqueName: \"kubernetes.io/projected/fa953017-fcf7-43f2-a33b-a3697bcc01f2-kube-api-access-jhhb2\") pod \"kube-state-metrics-54fd6bc5c4-6xk42\" (UID: \"fa953017-fcf7-43f2-a33b-a3697bcc01f2\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.484166 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484096    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d473dd5-f422-4e9d-af0a-b0cd61270c76-sys\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484166 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484132    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-wtmp\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484166 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484164    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nghf5\" (UniqueName: \"kubernetes.io/projected/4d473dd5-f422-4e9d-af0a-b0cd61270c76-kube-api-access-nghf5\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484385 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484190    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-textfile\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484385 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484200    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d473dd5-f422-4e9d-af0a-b0cd61270c76-sys\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484385 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484220    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d473dd5-f422-4e9d-af0a-b0cd61270c76-metrics-client-ca\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484385 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484248    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484385 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484271    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-wtmp\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484385 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484281    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4d473dd5-f422-4e9d-af0a-b0cd61270c76-root\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484385 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484364    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-tls\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484758 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484399    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-accelerators-collector-config\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484758 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484423    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4d473dd5-f422-4e9d-af0a-b0cd61270c76-root\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484758 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:43.484521    2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 20 20:51:43.484758 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484554    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-textfile\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.484758 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:43.484586    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-tls podName:4d473dd5-f422-4e9d-af0a-b0cd61270c76 nodeName:}" failed. No retries permitted until 2026-05-20 20:51:43.984568726 +0000 UTC m=+176.914165458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-tls") pod "node-exporter-wr6b6" (UID: "4d473dd5-f422-4e9d-af0a-b0cd61270c76") : secret "node-exporter-tls" not found
May 20 20:51:43.485011 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.484892    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-accelerators-collector-config\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.485011 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.485005    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d473dd5-f422-4e9d-af0a-b0cd61270c76-metrics-client-ca\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.486364 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.486341    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.502105 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.502077    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nghf5\" (UniqueName: \"kubernetes.io/projected/4d473dd5-f422-4e9d-af0a-b0cd61270c76-kube-api-access-nghf5\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.550073 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.550042    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"
May 20 20:51:43.551776 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.551761    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"
May 20 20:51:43.709523 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.709496    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42"]
May 20 20:51:43.711604 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:43.711578    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa953017_fcf7_43f2_a33b_a3697bcc01f2.slice/crio-64411316a5a04aa75f13f959b58c0fc5d8c4ec56c6dd956485a6ab4fc246ea0b WatchSource:0}: Error finding container 64411316a5a04aa75f13f959b58c0fc5d8c4ec56c6dd956485a6ab4fc246ea0b: Status 404 returned error can't find the container with id 64411316a5a04aa75f13f959b58c0fc5d8c4ec56c6dd956485a6ab4fc246ea0b
May 20 20:51:43.723498 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.723474    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-flvpm"]
May 20 20:51:43.726262 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:43.726232    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0cba94_3573_4887_86a5_32d8c4c47963.slice/crio-d940d2d993bdd1c6219dff011c4f823bd3cd6b02ea7fff8122a75e2370e4d70e WatchSource:0}: Error finding container d940d2d993bdd1c6219dff011c4f823bd3cd6b02ea7fff8122a75e2370e4d70e: Status 404 returned error can't find the container with id d940d2d993bdd1c6219dff011c4f823bd3cd6b02ea7fff8122a75e2370e4d70e
May 20 20:51:43.990931 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.990863    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-tls\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:43.992997 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:43.992980    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4d473dd5-f422-4e9d-af0a-b0cd61270c76-node-exporter-tls\") pod \"node-exporter-wr6b6\" (UID: \"4d473dd5-f422-4e9d-af0a-b0cd61270c76\") " pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:44.180336 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.180305    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wr6b6"
May 20 20:51:44.193696 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:44.193661    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d473dd5_f422_4e9d_af0a_b0cd61270c76.slice/crio-3367a482cb3d401330de68f181507eae48eccd376c2bdcd15e9216a4c9ee6791 WatchSource:0}: Error finding container 3367a482cb3d401330de68f181507eae48eccd376c2bdcd15e9216a4c9ee6791: Status 404 returned error can't find the container with id 3367a482cb3d401330de68f181507eae48eccd376c2bdcd15e9216a4c9ee6791
May 20 20:51:44.249066 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.249007    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wr6b6" event={"ID":"4d473dd5-f422-4e9d-af0a-b0cd61270c76","Type":"ContainerStarted","Data":"3367a482cb3d401330de68f181507eae48eccd376c2bdcd15e9216a4c9ee6791"}
May 20 20:51:44.250134 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.250106    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42" event={"ID":"fa953017-fcf7-43f2-a33b-a3697bcc01f2","Type":"ContainerStarted","Data":"64411316a5a04aa75f13f959b58c0fc5d8c4ec56c6dd956485a6ab4fc246ea0b"}
May 20 20:51:44.251733 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.251710    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm" event={"ID":"ed0cba94-3573-4887-86a5-32d8c4c47963","Type":"ContainerStarted","Data":"80fdfe8c651a3671c062923c739f7f7acd5506a0b005a71cadf192fe8e7f69af"}
May 20 20:51:44.251816 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.251739    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm" event={"ID":"ed0cba94-3573-4887-86a5-32d8c4c47963","Type":"ContainerStarted","Data":"fa71f833880b397d587f029961f9916d5a7839fb805c7fe61b376e9c70ea1760"}
May 20 20:51:44.251816 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.251749    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm" event={"ID":"ed0cba94-3573-4887-86a5-32d8c4c47963","Type":"ContainerStarted","Data":"d940d2d993bdd1c6219dff011c4f823bd3cd6b02ea7fff8122a75e2370e4d70e"}
May 20 20:51:44.337952 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.337929    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:51:44.340970 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.340953    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.343847 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.343827    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 20 20:51:44.343977 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.343957    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 20 20:51:44.344043 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.344012    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 20 20:51:44.344111 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.344092    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 20 20:51:44.344590 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.344572    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 20 20:51:44.344680 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.344646    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 20 20:51:44.344680 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.344652    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 20 20:51:44.344781 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.344680    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 20 20:51:44.344932 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.344912    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 20 20:51:44.345075 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.345059    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ftcwk\""
May 20 20:51:44.357232 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.357210    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:51:44.394620 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.394589    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.394738 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.394640    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.394738 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.394669    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.394738 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.394699    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.394738 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.394728    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-config-volume\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.394966 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.394756    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.394966 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.394785    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-web-config\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.394966 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.394812    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.394966 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.394840    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.394966 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.394868    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.394966 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.394906    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v4fs\" (UniqueName: \"kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-kube-api-access-7v4fs\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.395268 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.395061    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-config-out\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.395268 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.395115    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496214 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496184    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7v4fs\" (UniqueName: \"kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-kube-api-access-7v4fs\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496357 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496228    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-config-out\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496357 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496269    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496357 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496315    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496357 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496347    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496706 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496371    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496706 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496402    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496706 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496446    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-config-volume\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496706 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496476    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496706 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496502    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-web-config\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496706 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496531    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496706 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496574    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.496706 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.496609    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.497492 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.497279    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.498004 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:51:44.497686    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-trusted-ca-bundle podName:3202480a-4da4-4e99-8474-cb8ca6912af1 nodeName:}" failed. No retries permitted until 2026-05-20 20:51:44.997662552 +0000 UTC m=+177.927259287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1") : configmap references non-existent config key: ca-bundle.crt
May 20 20:51:44.498615 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.498589    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.499985 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.499929    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.501533 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.501323    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-config-out\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.501533 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.501363    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.502110 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.502028    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-web-config\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.502110 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.502097    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.502970 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.502950    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.502970 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.502958    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.503121 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.502958    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.503412 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.503365    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-config-volume\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:44.507609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:44.507589    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v4fs\" (UniqueName: \"kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-kube-api-access-7v4fs\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:45.002269 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.002223    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:45.003065 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.003043    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:45.254138 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.254056    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:51:45.383026 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.383004    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68bc756c4c-m8c29"]
May 20 20:51:45.386083 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.386062    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.390055 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.390031    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6p5q0jgv88m57\""
May 20 20:51:45.390164 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.390115    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 20 20:51:45.390336 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.390319    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 20 20:51:45.395672 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.395425    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 20 20:51:45.395672 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.395545    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lskdg\""
May 20 20:51:45.395672 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.395548    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 20 20:51:45.395672 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.395655    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 20 20:51:45.410152 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.410125    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68bc756c4c-m8c29"]
May 20 20:51:45.507314 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.506810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.507314 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.506860    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46dbc865-2b0a-4427-aebe-1d31be27d729-metrics-client-ca\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.507314 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.506903    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.507314 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.506940    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-grpc-tls\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.507314 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.506977    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw75m\" (UniqueName: \"kubernetes.io/projected/46dbc865-2b0a-4427-aebe-1d31be27d729-kube-api-access-kw75m\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.507314 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.507005    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.507314 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.507046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-tls\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.507314 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.507104    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.533261 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.533211    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:51:45.538457 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:45.538392    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3202480a_4da4_4e99_8474_cb8ca6912af1.slice/crio-cb622293576b5de06138dee67cbe30b797059b9c698f9c67b0de4e0aee753310 WatchSource:0}: Error finding container cb622293576b5de06138dee67cbe30b797059b9c698f9c67b0de4e0aee753310: Status 404 returned error can't find the container with id cb622293576b5de06138dee67cbe30b797059b9c698f9c67b0de4e0aee753310
May 20 20:51:45.607656 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.607627    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.607656 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.607660    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46dbc865-2b0a-4427-aebe-1d31be27d729-metrics-client-ca\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.607863 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.607804    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.607930 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.607862    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-grpc-tls\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.607983 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.607937    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kw75m\" (UniqueName: \"kubernetes.io/projected/46dbc865-2b0a-4427-aebe-1d31be27d729-kube-api-access-kw75m\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.607983 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.607976    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.608088 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.608021    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-tls\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.608088 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.608078    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.608688 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.608459    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46dbc865-2b0a-4427-aebe-1d31be27d729-metrics-client-ca\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.610684 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.610604    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.611040 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.611015    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.611252 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.611230    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-grpc-tls\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.611564 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.611521    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.611924 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.611895    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.612001 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.611926    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/46dbc865-2b0a-4427-aebe-1d31be27d729-secret-thanos-querier-tls\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.618548 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.618524    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw75m\" (UniqueName: \"kubernetes.io/projected/46dbc865-2b0a-4427-aebe-1d31be27d729-kube-api-access-kw75m\") pod \"thanos-querier-68bc756c4c-m8c29\" (UID: \"46dbc865-2b0a-4427-aebe-1d31be27d729\") " pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.731572 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.731545    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:45.864555 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:45.864532    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68bc756c4c-m8c29"]
May 20 20:51:45.867922 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:45.867890    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46dbc865_2b0a_4427_aebe_1d31be27d729.slice/crio-2b4f863620840bce17857d01044b24068a51f5764158aac787717010d64ef77d WatchSource:0}: Error finding container 2b4f863620840bce17857d01044b24068a51f5764158aac787717010d64ef77d: Status 404 returned error can't find the container with id 2b4f863620840bce17857d01044b24068a51f5764158aac787717010d64ef77d
May 20 20:51:46.259994 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:46.259958    2556 generic.go:358] "Generic (PLEG): container finished" podID="4d473dd5-f422-4e9d-af0a-b0cd61270c76" containerID="ac5353cdf3508a8479b089dc1224f176534f7df0e28e49eddae21c778f4359b9" exitCode=0
May 20 20:51:46.260412 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:46.260048    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wr6b6" event={"ID":"4d473dd5-f422-4e9d-af0a-b0cd61270c76","Type":"ContainerDied","Data":"ac5353cdf3508a8479b089dc1224f176534f7df0e28e49eddae21c778f4359b9"}
May 20 20:51:46.262509 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:46.262480    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42" event={"ID":"fa953017-fcf7-43f2-a33b-a3697bcc01f2","Type":"ContainerStarted","Data":"1ab0bb085b57836564fe3bf37ca50f1f98cadfcfc7c140c77ff1c30b6c62dd38"}
May 20 20:51:46.262632 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:46.262517    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42" event={"ID":"fa953017-fcf7-43f2-a33b-a3697bcc01f2","Type":"ContainerStarted","Data":"31327690ef49cfdd943243c196442abfcba1eb4d228f15156803e6d4050292ce"}
May 20 20:51:46.262632 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:46.262530    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42" event={"ID":"fa953017-fcf7-43f2-a33b-a3697bcc01f2","Type":"ContainerStarted","Data":"92b2d4208e137b2ce21e4f10ceae38c989f089bdcac8aa3c5b06669785defa57"}
May 20 20:51:46.264574 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:46.264527    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm" event={"ID":"ed0cba94-3573-4887-86a5-32d8c4c47963","Type":"ContainerStarted","Data":"3b7698aa335e35f788cae2f59f0cea61deaacc1aec158da730fd4c687759cd98"}
May 20 20:51:46.265755 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:46.265726    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29" event={"ID":"46dbc865-2b0a-4427-aebe-1d31be27d729","Type":"ContainerStarted","Data":"2b4f863620840bce17857d01044b24068a51f5764158aac787717010d64ef77d"}
May 20 20:51:46.266887 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:46.266866    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerStarted","Data":"cb622293576b5de06138dee67cbe30b797059b9c698f9c67b0de4e0aee753310"}
May 20 20:51:46.336152 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:46.336081    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-flvpm" podStartSLOduration=1.7824563310000001 podStartE2EDuration="3.336066735s" podCreationTimestamp="2026-05-20 20:51:43 +0000 UTC" firstStartedPulling="2026-05-20 20:51:43.822256446 +0000 UTC m=+176.751853163" lastFinishedPulling="2026-05-20 20:51:45.375866835 +0000 UTC m=+178.305463567" observedRunningTime="2026-05-20 20:51:46.33589316 +0000 UTC m=+179.265489903" watchObservedRunningTime="2026-05-20 20:51:46.336066735 +0000 UTC m=+179.265663476"
May 20 20:51:46.336301 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:46.336256    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6xk42" podStartSLOduration=1.673875123 podStartE2EDuration="3.336248218s" podCreationTimestamp="2026-05-20 20:51:43 +0000 UTC" firstStartedPulling="2026-05-20 20:51:43.713492855 +0000 UTC m=+176.643089573" lastFinishedPulling="2026-05-20 20:51:45.375865949 +0000 UTC m=+178.305462668" observedRunningTime="2026-05-20 20:51:46.308576748 +0000 UTC m=+179.238173486" watchObservedRunningTime="2026-05-20 20:51:46.336248218 +0000 UTC m=+179.265844957"
May 20 20:51:47.272685 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:47.272650    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wr6b6" event={"ID":"4d473dd5-f422-4e9d-af0a-b0cd61270c76","Type":"ContainerStarted","Data":"36c0ae555126d2ed08a481214c9539e8e4ed0f373f1469d93865037f818b8346"}
May 20 20:51:47.272685 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:47.272688    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wr6b6" event={"ID":"4d473dd5-f422-4e9d-af0a-b0cd61270c76","Type":"ContainerStarted","Data":"dfa39846adf01542fcb419c55153b525f121abf45212fdb405408cc841073b41"}
May 20 20:51:47.274085 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:47.274059    2556 generic.go:358] "Generic (PLEG): container finished" podID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerID="5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329" exitCode=0
May 20 20:51:47.274218 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:47.274133    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerDied","Data":"5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329"}
May 20 20:51:47.297715 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:47.297667    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wr6b6" podStartSLOduration=3.116683776 podStartE2EDuration="4.297652836s" podCreationTimestamp="2026-05-20 20:51:43 +0000 UTC" firstStartedPulling="2026-05-20 20:51:44.195812559 +0000 UTC m=+177.125409290" lastFinishedPulling="2026-05-20 20:51:45.376781631 +0000 UTC m=+178.306378350" observedRunningTime="2026-05-20 20:51:47.29601201 +0000 UTC m=+180.225608751" watchObservedRunningTime="2026-05-20 20:51:47.297652836 +0000 UTC m=+180.227249574"
May 20 20:51:48.281299 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:48.281260    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29" event={"ID":"46dbc865-2b0a-4427-aebe-1d31be27d729","Type":"ContainerStarted","Data":"57891f8e2898f4a0bc981b9f36253b4de345462f069cd33137d4fb232fa71382"}
May 20 20:51:48.281812 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:48.281307    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29" event={"ID":"46dbc865-2b0a-4427-aebe-1d31be27d729","Type":"ContainerStarted","Data":"a483b1d10573313c3bb5ba2977dfff5ca07bd1924d6ac92ec6f0f4f4766e8d22"}
May 20 20:51:48.281812 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:48.281321    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29" event={"ID":"46dbc865-2b0a-4427-aebe-1d31be27d729","Type":"ContainerStarted","Data":"3a0a6ce041a96847ef1ad5095e53ca273d43667f9925a9007a6cfd081de2be71"}
May 20 20:51:49.286532 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.286496    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29" event={"ID":"46dbc865-2b0a-4427-aebe-1d31be27d729","Type":"ContainerStarted","Data":"edbe968a29cc8299bda6280fdef90f6eea550e5a719052353338d8863bd1e336"}
May 20 20:51:49.286532 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.286534    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29" event={"ID":"46dbc865-2b0a-4427-aebe-1d31be27d729","Type":"ContainerStarted","Data":"ea44eed66da9cb2449f61850ee85710b39d18387b825ed06771a412337b441f7"}
May 20 20:51:49.286969 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.286543    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29" event={"ID":"46dbc865-2b0a-4427-aebe-1d31be27d729","Type":"ContainerStarted","Data":"5db4fcaedb610a00e1e5498a9f9100c21d3e3575e066f957d1f8588961edd543"}
May 20 20:51:49.286969 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.286672    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:49.289144 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.289121    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerStarted","Data":"e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41"}
May 20 20:51:49.289226 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.289147    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerStarted","Data":"a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0"}
May 20 20:51:49.289226 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.289156    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerStarted","Data":"d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d"}
May 20 20:51:49.289226 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.289165    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerStarted","Data":"2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a"}
May 20 20:51:49.289226 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.289173    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerStarted","Data":"a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6"}
May 20 20:51:49.289226 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.289180    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerStarted","Data":"9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada"}
May 20 20:51:49.314963 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.314920    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29" podStartSLOduration=1.351215695 podStartE2EDuration="4.31490884s" podCreationTimestamp="2026-05-20 20:51:45 +0000 UTC" firstStartedPulling="2026-05-20 20:51:45.871671445 +0000 UTC m=+178.801268162" lastFinishedPulling="2026-05-20 20:51:48.83536459 +0000 UTC m=+181.764961307" observedRunningTime="2026-05-20 20:51:49.313555722 +0000 UTC m=+182.243152462" watchObservedRunningTime="2026-05-20 20:51:49.31490884 +0000 UTC m=+182.244505578"
May 20 20:51:49.342816 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:49.342750    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.066897168 podStartE2EDuration="5.342739891s" podCreationTimestamp="2026-05-20 20:51:44 +0000 UTC" firstStartedPulling="2026-05-20 20:51:45.540729707 +0000 UTC m=+178.470326424" lastFinishedPulling="2026-05-20 20:51:48.816572426 +0000 UTC m=+181.746169147" observedRunningTime="2026-05-20 20:51:49.341721694 +0000 UTC m=+182.271318433" watchObservedRunningTime="2026-05-20 20:51:49.342739891 +0000 UTC m=+182.272336682"
May 20 20:51:51.682100 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.682062    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b5fd65b4-pdshl"]
May 20 20:51:51.684618 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.684595    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.686823 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.686802    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 20 20:51:51.687559 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.687542    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 20 20:51:51.687664 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.687643    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 20 20:51:51.687664 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.687661    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 20 20:51:51.687791 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.687713    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 20 20:51:51.687791 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.687647    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-46kgk\""
May 20 20:51:51.687985 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.687967    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 20 20:51:51.688166 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.688153    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 20 20:51:51.693383 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.693345    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 20 20:51:51.716454 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.701014    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5fd65b4-pdshl"]
May 20 20:51:51.767732 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.767703    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-service-ca\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.767876 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.767768    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-trusted-ca-bundle\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.767876 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.767815    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-oauth-config\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.768003 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.767892    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-serving-cert\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.768003 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.767910    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-oauth-serving-cert\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.768003 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.767928    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-console-config\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.768003 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.767969    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fhmz\" (UniqueName: \"kubernetes.io/projected/4f5e06df-5102-4083-a35a-8972e46da875-kube-api-access-5fhmz\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.869270 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.869247    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-serving-cert\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.869270 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.869273    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-oauth-serving-cert\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.869502 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.869291    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-console-config\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.869502 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.869317    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5fhmz\" (UniqueName: \"kubernetes.io/projected/4f5e06df-5102-4083-a35a-8972e46da875-kube-api-access-5fhmz\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.869502 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.869451    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-service-ca\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.869678 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.869511    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-trusted-ca-bundle\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.869678 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.869541    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-oauth-config\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.870070 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.870047    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-console-config\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.870319 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.870295    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-oauth-serving-cert\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.870666 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.870636    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-service-ca\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.870948 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.870907    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-trusted-ca-bundle\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.872041 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.872023    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-serving-cert\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.872181 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.872162    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-oauth-config\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.878858 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.878835    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fhmz\" (UniqueName: \"kubernetes.io/projected/4f5e06df-5102-4083-a35a-8972e46da875-kube-api-access-5fhmz\") pod \"console-b5fd65b4-pdshl\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") " pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:51.995506 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:51.995423    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:51:52.118177 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:52.118153    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5fd65b4-pdshl"]
May 20 20:51:52.120664 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:52.120635    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5e06df_5102_4083_a35a_8972e46da875.slice/crio-3935a6ad4bc4c734120026341302aff3ba550641e0352bed2931bba2fd24b557 WatchSource:0}: Error finding container 3935a6ad4bc4c734120026341302aff3ba550641e0352bed2931bba2fd24b557: Status 404 returned error can't find the container with id 3935a6ad4bc4c734120026341302aff3ba550641e0352bed2931bba2fd24b557
May 20 20:51:52.299986 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:52.299915    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5fd65b4-pdshl" event={"ID":"4f5e06df-5102-4083-a35a-8972e46da875","Type":"ContainerStarted","Data":"3935a6ad4bc4c734120026341302aff3ba550641e0352bed2931bba2fd24b557"}
May 20 20:51:55.297870 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.297843    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68bc756c4c-m8c29"
May 20 20:51:55.310645 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.310617    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5fd65b4-pdshl" event={"ID":"4f5e06df-5102-4083-a35a-8972e46da875","Type":"ContainerStarted","Data":"290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629"}
May 20 20:51:55.349337 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.349284    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b5fd65b4-pdshl" podStartSLOduration=1.8706935040000001 podStartE2EDuration="4.349271656s" podCreationTimestamp="2026-05-20 20:51:51 +0000 UTC" firstStartedPulling="2026-05-20 20:51:52.122511006 +0000 UTC m=+185.052107723" lastFinishedPulling="2026-05-20 20:51:54.601089158 +0000 UTC m=+187.530685875" observedRunningTime="2026-05-20 20:51:55.349013711 +0000 UTC m=+188.278610447" watchObservedRunningTime="2026-05-20 20:51:55.349271656 +0000 UTC m=+188.278868396"
May 20 20:51:55.694382 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.694350    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5fd65b4-pdshl"]
May 20 20:51:55.744502 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.744428    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-844d9c6b4d-blmt5"]
May 20 20:51:55.747038 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.747021    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:55.762415 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.762391    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844d9c6b4d-blmt5"]
May 20 20:51:55.905852 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.905821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-service-ca\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:55.906009 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.905874    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-oauth-config\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:55.906009 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.905949    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-oauth-serving-cert\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:55.906090 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.906007    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-serving-cert\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:55.906090 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.906046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-trusted-ca-bundle\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:55.906090 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.906065    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n25bb\" (UniqueName: \"kubernetes.io/projected/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-kube-api-access-n25bb\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:55.906176 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:55.906090    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-config\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.006994 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.006923    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-oauth-config\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.006994 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.006979    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-oauth-serving-cert\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.007165 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.007003    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-serving-cert\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.007165 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.007023    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-trusted-ca-bundle\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.007165 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.007040    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n25bb\" (UniqueName: \"kubernetes.io/projected/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-kube-api-access-n25bb\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.007165 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.007067    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-config\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.007165 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.007092    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-service-ca\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.007869 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.007843    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-trusted-ca-bundle\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.007971 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.007879    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-config\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.007971 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.007892    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-service-ca\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.008086 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.007972    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-oauth-serving-cert\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.009399 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.009374    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-oauth-config\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.009539 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.009522    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-serving-cert\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.017274 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.017255    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n25bb\" (UniqueName: \"kubernetes.io/projected/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-kube-api-access-n25bb\") pod \"console-844d9c6b4d-blmt5\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") " pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.056033 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.056013    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:51:56.181511 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.181487    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844d9c6b4d-blmt5"]
May 20 20:51:56.183927 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:51:56.183902    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed92c04_da5d_4f2e_a6ee_598c9ca8f267.slice/crio-a755d1202822def1c279ba36aced435c8f9c1e0278e8add87c849ce382627d96 WatchSource:0}: Error finding container a755d1202822def1c279ba36aced435c8f9c1e0278e8add87c849ce382627d96: Status 404 returned error can't find the container with id a755d1202822def1c279ba36aced435c8f9c1e0278e8add87c849ce382627d96
May 20 20:51:56.317752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.317678    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844d9c6b4d-blmt5" event={"ID":"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267","Type":"ContainerStarted","Data":"6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a"}
May 20 20:51:56.317752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.317714    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844d9c6b4d-blmt5" event={"ID":"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267","Type":"ContainerStarted","Data":"a755d1202822def1c279ba36aced435c8f9c1e0278e8add87c849ce382627d96"}
May 20 20:51:56.344570 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:51:56.344520    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-844d9c6b4d-blmt5" podStartSLOduration=1.344502922 podStartE2EDuration="1.344502922s" podCreationTimestamp="2026-05-20 20:51:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:51:56.342922927 +0000 UTC m=+189.272519668" watchObservedRunningTime="2026-05-20 20:51:56.344502922 +0000 UTC m=+189.274099663"
May 20 20:52:01.996589 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:01.996555    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:52:02.336124 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:02.336061    2556 generic.go:358] "Generic (PLEG): container finished" podID="e6fe8a3e-de98-45ea-93e8-13d47fbb14ec" containerID="c685e8c6f5a83d862cfe25ce7d4a2afa6c2fdd5bc940ef28cc49e73eae61da33" exitCode=0
May 20 20:52:02.336277 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:02.336136    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7" event={"ID":"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec","Type":"ContainerDied","Data":"c685e8c6f5a83d862cfe25ce7d4a2afa6c2fdd5bc940ef28cc49e73eae61da33"}
May 20 20:52:02.336419 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:02.336405    2556 scope.go:117] "RemoveContainer" containerID="c685e8c6f5a83d862cfe25ce7d4a2afa6c2fdd5bc940ef28cc49e73eae61da33"
May 20 20:52:03.340408 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:03.340377    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-qqbh7" event={"ID":"e6fe8a3e-de98-45ea-93e8-13d47fbb14ec","Type":"ContainerStarted","Data":"42176058aaed9c29d2ce65b2b2312bfe73917ddda1e032372d3de6a4e82c8a26"}
May 20 20:52:06.056325 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:06.056287    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:52:06.056822 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:06.056334    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:52:06.061072 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:06.061050    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:52:06.352739 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:06.352665    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:52:17.381185 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:17.381152    2556 generic.go:358] "Generic (PLEG): container finished" podID="ed3815d4-6e62-48d0-93c5-cd5e306c1b5d" containerID="0886b14e2ec40635271dfe4ac611f4ad000ba87940a509e5aaae7e745bab1ed8" exitCode=0
May 20 20:52:17.381535 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:17.381225    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xp8tn" event={"ID":"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d","Type":"ContainerDied","Data":"0886b14e2ec40635271dfe4ac611f4ad000ba87940a509e5aaae7e745bab1ed8"}
May 20 20:52:17.381603 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:17.381557    2556 scope.go:117] "RemoveContainer" containerID="0886b14e2ec40635271dfe4ac611f4ad000ba87940a509e5aaae7e745bab1ed8"
May 20 20:52:18.004707 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:18.004651    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bd77c4d94-5l8ck_f4402bc2-97c9-4867-8e96-4938d325a1fa/router/0.log"
May 20 20:52:18.012478 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:18.012456    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h2df2_48b7525a-3a26-423d-9eb2-64ea2179f1d3/serve-healthcheck-canary/0.log"
May 20 20:52:18.385498 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:18.385392    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-xp8tn" event={"ID":"ed3815d4-6e62-48d0-93c5-cd5e306c1b5d","Type":"ContainerStarted","Data":"a3adfc868bf2558105d3dccb22cc47918d20e093a975cef7438aaac186286c94"}
May 20 20:52:22.340231 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.340188    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-b5fd65b4-pdshl" podUID="4f5e06df-5102-4083-a35a-8972e46da875" containerName="console" containerID="cri-o://290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629" gracePeriod=15
May 20 20:52:22.594036 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.593982    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b5fd65b4-pdshl_4f5e06df-5102-4083-a35a-8972e46da875/console/0.log"
May 20 20:52:22.594138 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.594052    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:52:22.634055 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634031    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-console-config\") pod \"4f5e06df-5102-4083-a35a-8972e46da875\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") "
May 20 20:52:22.634167 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634069    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-oauth-config\") pod \"4f5e06df-5102-4083-a35a-8972e46da875\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") "
May 20 20:52:22.634167 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634088    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-service-ca\") pod \"4f5e06df-5102-4083-a35a-8972e46da875\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") "
May 20 20:52:22.634167 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634121    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-serving-cert\") pod \"4f5e06df-5102-4083-a35a-8972e46da875\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") "
May 20 20:52:22.634294 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634248    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fhmz\" (UniqueName: \"kubernetes.io/projected/4f5e06df-5102-4083-a35a-8972e46da875-kube-api-access-5fhmz\") pod \"4f5e06df-5102-4083-a35a-8972e46da875\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") "
May 20 20:52:22.634346 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634307    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-oauth-serving-cert\") pod \"4f5e06df-5102-4083-a35a-8972e46da875\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") "
May 20 20:52:22.634396 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634348    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-trusted-ca-bundle\") pod \"4f5e06df-5102-4083-a35a-8972e46da875\" (UID: \"4f5e06df-5102-4083-a35a-8972e46da875\") "
May 20 20:52:22.634594 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634531    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f5e06df-5102-4083-a35a-8972e46da875" (UID: "4f5e06df-5102-4083-a35a-8972e46da875"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:52:22.634594 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634547    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-console-config" (OuterVolumeSpecName: "console-config") pod "4f5e06df-5102-4083-a35a-8972e46da875" (UID: "4f5e06df-5102-4083-a35a-8972e46da875"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:52:22.634854 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634747    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-console-config\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:52:22.634854 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634768    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-service-ca\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:52:22.634854 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634778    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f5e06df-5102-4083-a35a-8972e46da875" (UID: "4f5e06df-5102-4083-a35a-8972e46da875"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:52:22.635024 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.634854    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4f5e06df-5102-4083-a35a-8972e46da875" (UID: "4f5e06df-5102-4083-a35a-8972e46da875"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:52:22.636418 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.636394    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f5e06df-5102-4083-a35a-8972e46da875" (UID: "4f5e06df-5102-4083-a35a-8972e46da875"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:52:22.636755 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.636734    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f5e06df-5102-4083-a35a-8972e46da875" (UID: "4f5e06df-5102-4083-a35a-8972e46da875"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:52:22.636755 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.636747    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f5e06df-5102-4083-a35a-8972e46da875-kube-api-access-5fhmz" (OuterVolumeSpecName: "kube-api-access-5fhmz") pod "4f5e06df-5102-4083-a35a-8972e46da875" (UID: "4f5e06df-5102-4083-a35a-8972e46da875"). InnerVolumeSpecName "kube-api-access-5fhmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:52:22.736027 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.735997    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-oauth-serving-cert\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:52:22.736027 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.736022    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f5e06df-5102-4083-a35a-8972e46da875-trusted-ca-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:52:22.736027 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.736033    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-oauth-config\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:52:22.736240 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.736042    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f5e06df-5102-4083-a35a-8972e46da875-console-serving-cert\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:52:22.736240 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:22.736052    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fhmz\" (UniqueName: \"kubernetes.io/projected/4f5e06df-5102-4083-a35a-8972e46da875-kube-api-access-5fhmz\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:52:23.400635 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:23.400610    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b5fd65b4-pdshl_4f5e06df-5102-4083-a35a-8972e46da875/console/0.log"
May 20 20:52:23.401028 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:23.400651    2556 generic.go:358] "Generic (PLEG): container finished" podID="4f5e06df-5102-4083-a35a-8972e46da875" containerID="290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629" exitCode=2
May 20 20:52:23.401028 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:23.400689    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5fd65b4-pdshl" event={"ID":"4f5e06df-5102-4083-a35a-8972e46da875","Type":"ContainerDied","Data":"290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629"}
May 20 20:52:23.401028 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:23.400718    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5fd65b4-pdshl"
May 20 20:52:23.401028 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:23.400734    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5fd65b4-pdshl" event={"ID":"4f5e06df-5102-4083-a35a-8972e46da875","Type":"ContainerDied","Data":"3935a6ad4bc4c734120026341302aff3ba550641e0352bed2931bba2fd24b557"}
May 20 20:52:23.401028 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:23.400752    2556 scope.go:117] "RemoveContainer" containerID="290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629"
May 20 20:52:23.409900 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:23.409884    2556 scope.go:117] "RemoveContainer" containerID="290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629"
May 20 20:52:23.410167 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:52:23.410148    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629\": container with ID starting with 290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629 not found: ID does not exist" containerID="290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629"
May 20 20:52:23.410221 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:23.410175    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629"} err="failed to get container status \"290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629\": rpc error: code = NotFound desc = could not find container \"290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629\": container with ID starting with 290c263614acd8bcff967307314f9f6b4b464d6fb5d76cc8ef0629bf4cf5e629 not found: ID does not exist"
May 20 20:52:23.423351 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:23.423329    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5fd65b4-pdshl"]
May 20 20:52:23.428635 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:23.428614    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b5fd65b4-pdshl"]
May 20 20:52:23.675195 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:23.675100    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f5e06df-5102-4083-a35a-8972e46da875" path="/var/lib/kubelet/pods/4f5e06df-5102-4083-a35a-8972e46da875/volumes"
May 20 20:52:59.416600 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:59.416568    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:52:59.418922 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:59.418902    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8322035-26e8-42bd-9269-3ba2a2284d96-metrics-certs\") pod \"network-metrics-daemon-xmtnp\" (UID: \"f8322035-26e8-42bd-9269-3ba2a2284d96\") " pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:52:59.574035 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:59.574006    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-q28sq\""
May 20 20:52:59.582240 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:59.582224    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmtnp"
May 20 20:52:59.704269 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:52:59.704246    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmtnp"]
May 20 20:52:59.706913 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:52:59.706871    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8322035_26e8_42bd_9269_3ba2a2284d96.slice/crio-caba7e203bd3669ce8f8959814b154c6292e26011005d87144a4df1da5c0665d WatchSource:0}: Error finding container caba7e203bd3669ce8f8959814b154c6292e26011005d87144a4df1da5c0665d: Status 404 returned error can't find the container with id caba7e203bd3669ce8f8959814b154c6292e26011005d87144a4df1da5c0665d
May 20 20:53:00.510753 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:00.510719    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmtnp" event={"ID":"f8322035-26e8-42bd-9269-3ba2a2284d96","Type":"ContainerStarted","Data":"caba7e203bd3669ce8f8959814b154c6292e26011005d87144a4df1da5c0665d"}
May 20 20:53:01.515324 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.515284    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmtnp" event={"ID":"f8322035-26e8-42bd-9269-3ba2a2284d96","Type":"ContainerStarted","Data":"42faebbe939555f92b69515d0fc370b5a2cac9ee12fc59faccc88be157fc4ddf"}
May 20 20:53:01.515324 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.515323    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmtnp" event={"ID":"f8322035-26e8-42bd-9269-3ba2a2284d96","Type":"ContainerStarted","Data":"ca1dc016c539caf3edaed7df9038c3f80636e30097ef0807b590eec644db82ee"}
May 20 20:53:01.535423 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.535375    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xmtnp" podStartSLOduration=253.474072372 podStartE2EDuration="4m14.53536241s" podCreationTimestamp="2026-05-20 20:48:47 +0000 UTC" firstStartedPulling="2026-05-20 20:52:59.708483414 +0000 UTC m=+252.638080132" lastFinishedPulling="2026-05-20 20:53:00.769773451 +0000 UTC m=+253.699370170" observedRunningTime="2026-05-20 20:53:01.533889141 +0000 UTC m=+254.463485879" watchObservedRunningTime="2026-05-20 20:53:01.53536241 +0000 UTC m=+254.464959148"
May 20 20:53:01.650416 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.650386    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-65964847cc-jrr69"]
May 20 20:53:01.650779 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.650766    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f5e06df-5102-4083-a35a-8972e46da875" containerName="console"
May 20 20:53:01.650829 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.650782    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f5e06df-5102-4083-a35a-8972e46da875" containerName="console"
May 20 20:53:01.650863 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.650841    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f5e06df-5102-4083-a35a-8972e46da875" containerName="console"
May 20 20:53:01.653827 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.653810    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.669609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.669580    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65964847cc-jrr69"]
May 20 20:53:01.737449 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.737404    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-service-ca\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.737567 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.737475    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-serving-cert\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.737567 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.737503    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb22c\" (UniqueName: \"kubernetes.io/projected/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-kube-api-access-wb22c\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.737567 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.737534    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-oauth-config\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.737567 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.737556    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-trusted-ca-bundle\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.737697 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.737607    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-oauth-serving-cert\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.737697 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.737634    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-config\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.838467 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.838384    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wb22c\" (UniqueName: \"kubernetes.io/projected/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-kube-api-access-wb22c\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.838467 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.838449    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-oauth-config\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.838629 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.838475    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-trusted-ca-bundle\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.838629 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.838526    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-oauth-serving-cert\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.838629 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.838556    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-config\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.838629 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.838608    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-service-ca\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.838822 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.838647    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-serving-cert\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.839347 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.839322    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-oauth-serving-cert\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.839455 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.839397    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-service-ca\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.839505 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.839487    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-config\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.839543 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.839529    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-trusted-ca-bundle\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.840935 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.840918    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-oauth-config\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.841152 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.841133    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-serving-cert\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.848114 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.848092    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb22c\" (UniqueName: \"kubernetes.io/projected/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-kube-api-access-wb22c\") pod \"console-65964847cc-jrr69\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") " pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:01.964440 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:01.964411    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:02.093410 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:02.093383    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65964847cc-jrr69"]
May 20 20:53:02.095994 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:53:02.095967    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5021ed6_25d2_4c0f_a54a_8b0e0a1379a9.slice/crio-05491735afdf901267e536df5ae76ce1be3e8a70b5b2119f6a909b7afec7439c WatchSource:0}: Error finding container 05491735afdf901267e536df5ae76ce1be3e8a70b5b2119f6a909b7afec7439c: Status 404 returned error can't find the container with id 05491735afdf901267e536df5ae76ce1be3e8a70b5b2119f6a909b7afec7439c
May 20 20:53:02.522980 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:02.522938    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65964847cc-jrr69" event={"ID":"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9","Type":"ContainerStarted","Data":"f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199"}
May 20 20:53:02.522980 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:02.522984    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65964847cc-jrr69" event={"ID":"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9","Type":"ContainerStarted","Data":"05491735afdf901267e536df5ae76ce1be3e8a70b5b2119f6a909b7afec7439c"}
May 20 20:53:02.545235 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:02.545192    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-65964847cc-jrr69" podStartSLOduration=1.54517761 podStartE2EDuration="1.54517761s" podCreationTimestamp="2026-05-20 20:53:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:53:02.544396382 +0000 UTC m=+255.473993122" watchObservedRunningTime="2026-05-20 20:53:02.54517761 +0000 UTC m=+255.474774349"
May 20 20:53:03.785130 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:03.785093    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:53:03.785725 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:03.785684    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="alertmanager" containerID="cri-o://9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada" gracePeriod=120
May 20 20:53:03.785827 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:03.785734    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy-metric" containerID="cri-o://a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0" gracePeriod=120
May 20 20:53:03.785827 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:03.785803    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy-web" containerID="cri-o://2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a" gracePeriod=120
May 20 20:53:03.785970 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:03.785828    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="config-reloader" containerID="cri-o://a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6" gracePeriod=120
May 20 20:53:03.785970 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:03.785866    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy" containerID="cri-o://d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d" gracePeriod=120
May 20 20:53:03.785970 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:03.785799    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="prom-label-proxy" containerID="cri-o://e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41" gracePeriod=120
May 20 20:53:04.532445 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:04.532402    2556 generic.go:358] "Generic (PLEG): container finished" podID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerID="e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41" exitCode=0
May 20 20:53:04.532445 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:04.532426    2556 generic.go:358] "Generic (PLEG): container finished" podID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerID="d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d" exitCode=0
May 20 20:53:04.532445 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:04.532446    2556 generic.go:358] "Generic (PLEG): container finished" podID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerID="a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6" exitCode=0
May 20 20:53:04.532445 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:04.532452    2556 generic.go:358] "Generic (PLEG): container finished" podID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerID="9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada" exitCode=0
May 20 20:53:04.532740 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:04.532479    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerDied","Data":"e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41"}
May 20 20:53:04.532740 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:04.532517    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerDied","Data":"d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d"}
May 20 20:53:04.532740 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:04.532531    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerDied","Data":"a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6"}
May 20 20:53:04.532740 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:04.532544    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerDied","Data":"9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada"}
May 20 20:53:05.018228 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.018203    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.168120 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168091    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168296 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168149    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-config-volume\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168296 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168174    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-web-config\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168296 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168207    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-main-db\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168296 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168247    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168296 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168284    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-trusted-ca-bundle\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168582 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168331    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-main-tls\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168582 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168360    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-cluster-tls-config\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168582 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168395    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v4fs\" (UniqueName: \"kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-kube-api-access-7v4fs\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168582 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168473    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-tls-assets\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168582 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168499    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-web\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168582 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168539    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-metrics-client-ca\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168565    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-config-out\") pod \"3202480a-4da4-4e99-8474-cb8ca6912af1\" (UID: \"3202480a-4da4-4e99-8474-cb8ca6912af1\") "
May 20 20:53:05.168857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168581    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:53:05.168857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168815    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-main-db\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.169004 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.168916    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:53:05.170526 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.170487    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:53:05.171696 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.171655    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-config-volume" (OuterVolumeSpecName: "config-volume") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:05.171798 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.171699    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:05.171876 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.171812    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-config-out" (OuterVolumeSpecName: "config-out") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:53:05.171876 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.171858    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:05.172002 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.171887    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-kube-api-access-7v4fs" (OuterVolumeSpecName: "kube-api-access-7v4fs") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "kube-api-access-7v4fs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:53:05.172002 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.171932    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:05.172511 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.172484    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:53:05.173222 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.173199    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:05.175699 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.175672    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:05.182074 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.182054    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-web-config" (OuterVolumeSpecName: "web-config") pod "3202480a-4da4-4e99-8474-cb8ca6912af1" (UID: "3202480a-4da4-4e99-8474-cb8ca6912af1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:05.269723 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269698    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.269723 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269721    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-main-tls\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.269857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269731    2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-cluster-tls-config\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.269857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269740    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v4fs\" (UniqueName: \"kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-kube-api-access-7v4fs\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.269857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269749    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3202480a-4da4-4e99-8474-cb8ca6912af1-tls-assets\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.269857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269758    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.269857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269768    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3202480a-4da4-4e99-8474-cb8ca6912af1-metrics-client-ca\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.269857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269777    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3202480a-4da4-4e99-8474-cb8ca6912af1-config-out\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.269857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269786    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.269857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269795    2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-config-volume\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.269857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269804    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-web-config\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.269857 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.269812    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3202480a-4da4-4e99-8474-cb8ca6912af1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:05.538404 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.538311    2556 generic.go:358] "Generic (PLEG): container finished" podID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerID="a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0" exitCode=0
May 20 20:53:05.538404 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.538338    2556 generic.go:358] "Generic (PLEG): container finished" podID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerID="2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a" exitCode=0
May 20 20:53:05.538404 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.538361    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerDied","Data":"a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0"}
May 20 20:53:05.538404 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.538384    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerDied","Data":"2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a"}
May 20 20:53:05.538404 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.538397    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3202480a-4da4-4e99-8474-cb8ca6912af1","Type":"ContainerDied","Data":"cb622293576b5de06138dee67cbe30b797059b9c698f9c67b0de4e0aee753310"}
May 20 20:53:05.538404 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.538411    2556 scope.go:117] "RemoveContainer" containerID="e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41"
May 20 20:53:05.538849 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.538488    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.546550 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.546524    2556 scope.go:117] "RemoveContainer" containerID="a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0"
May 20 20:53:05.553418 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.553401    2556 scope.go:117] "RemoveContainer" containerID="d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d"
May 20 20:53:05.559667 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.559651    2556 scope.go:117] "RemoveContainer" containerID="2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a"
May 20 20:53:05.565659 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.565621    2556 scope.go:117] "RemoveContainer" containerID="a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6"
May 20 20:53:05.568683 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.568651    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:53:05.573501 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.573481    2556 scope.go:117] "RemoveContainer" containerID="9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada"
May 20 20:53:05.575054 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.575030    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:53:05.580276 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.580248    2556 scope.go:117] "RemoveContainer" containerID="5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329"
May 20 20:53:05.586661 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.586640    2556 scope.go:117] "RemoveContainer" containerID="e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41"
May 20 20:53:05.586898 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:53:05.586882    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41\": container with ID starting with e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41 not found: ID does not exist" containerID="e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41"
May 20 20:53:05.586947 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.586906    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41"} err="failed to get container status \"e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41\": rpc error: code = NotFound desc = could not find container \"e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41\": container with ID starting with e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41 not found: ID does not exist"
May 20 20:53:05.586947 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.586926    2556 scope.go:117] "RemoveContainer" containerID="a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0"
May 20 20:53:05.587153 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:53:05.587131    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0\": container with ID starting with a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0 not found: ID does not exist" containerID="a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0"
May 20 20:53:05.587199 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.587154    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0"} err="failed to get container status \"a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0\": rpc error: code = NotFound desc = could not find container \"a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0\": container with ID starting with a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0 not found: ID does not exist"
May 20 20:53:05.587199 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.587165    2556 scope.go:117] "RemoveContainer" containerID="d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d"
May 20 20:53:05.587338 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:53:05.587325    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d\": container with ID starting with d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d not found: ID does not exist" containerID="d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d"
May 20 20:53:05.587375 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.587340    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d"} err="failed to get container status \"d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d\": rpc error: code = NotFound desc = could not find container \"d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d\": container with ID starting with d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d not found: ID does not exist"
May 20 20:53:05.587375 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.587351    2556 scope.go:117] "RemoveContainer" containerID="2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a"
May 20 20:53:05.587799 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:53:05.587618    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a\": container with ID starting with 2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a not found: ID does not exist" containerID="2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a"
May 20 20:53:05.587799 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.587648    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a"} err="failed to get container status \"2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a\": rpc error: code = NotFound desc = could not find container \"2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a\": container with ID starting with 2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a not found: ID does not exist"
May 20 20:53:05.587799 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.587675    2556 scope.go:117] "RemoveContainer" containerID="a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6"
May 20 20:53:05.587942 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:53:05.587902    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6\": container with ID starting with a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6 not found: ID does not exist" containerID="a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6"
May 20 20:53:05.587942 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.587917    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6"} err="failed to get container status \"a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6\": rpc error: code = NotFound desc = could not find container \"a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6\": container with ID starting with a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6 not found: ID does not exist"
May 20 20:53:05.587942 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.587931    2556 scope.go:117] "RemoveContainer" containerID="9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada"
May 20 20:53:05.588131 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:53:05.588113    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada\": container with ID starting with 9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada not found: ID does not exist" containerID="9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada"
May 20 20:53:05.588191 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.588139    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada"} err="failed to get container status \"9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada\": rpc error: code = NotFound desc = could not find container \"9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada\": container with ID starting with 9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada not found: ID does not exist"
May 20 20:53:05.588191 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.588163    2556 scope.go:117] "RemoveContainer" containerID="5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329"
May 20 20:53:05.588390 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:53:05.588375    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329\": container with ID starting with 5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329 not found: ID does not exist" containerID="5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329"
May 20 20:53:05.588457 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.588393    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329"} err="failed to get container status \"5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329\": rpc error: code = NotFound desc = could not find container \"5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329\": container with ID starting with 5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329 not found: ID does not exist"
May 20 20:53:05.588457 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.588404    2556 scope.go:117] "RemoveContainer" containerID="e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41"
May 20 20:53:05.588630 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.588615    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41"} err="failed to get container status \"e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41\": rpc error: code = NotFound desc = could not find container \"e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41\": container with ID starting with e5c4a4283e81146b39fecb699c784b358dccfea604e5084474d4b4e48e383f41 not found: ID does not exist"
May 20 20:53:05.588630 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.588629    2556 scope.go:117] "RemoveContainer" containerID="a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0"
May 20 20:53:05.588790 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.588775    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0"} err="failed to get container status \"a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0\": rpc error: code = NotFound desc = could not find container \"a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0\": container with ID starting with a30fa1711fb935acb83795b1bef1dfe9738e7c3b050ac5e6cbac9441f568fad0 not found: ID does not exist"
May 20 20:53:05.588840 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.588789    2556 scope.go:117] "RemoveContainer" containerID="d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d"
May 20 20:53:05.588933 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.588920    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d"} err="failed to get container status \"d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d\": rpc error: code = NotFound desc = could not find container \"d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d\": container with ID starting with d0b78a6c9fd7d7d877f9eaffe61bf7e9341b536942199facb91d656d88f6ec2d not found: ID does not exist"
May 20 20:53:05.588933 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.588932    2556 scope.go:117] "RemoveContainer" containerID="2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a"
May 20 20:53:05.589077 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.589064    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a"} err="failed to get container status \"2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a\": rpc error: code = NotFound desc = could not find container \"2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a\": container with ID starting with 2cd1e900301fd14924b7d9c8ab7a8460c0e95689cf7bd839bf10565c72df563a not found: ID does not exist"
May 20 20:53:05.589077 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.589076    2556 scope.go:117] "RemoveContainer" containerID="a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6"
May 20 20:53:05.589262 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.589242    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6"} err="failed to get container status \"a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6\": rpc error: code = NotFound desc = could not find container \"a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6\": container with ID starting with a4ff18c3ff00bfd8f53f87ad722dbc2a1079b14234b9807a6fa9d5ce40a347d6 not found: ID does not exist"
May 20 20:53:05.589325 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.589264    2556 scope.go:117] "RemoveContainer" containerID="9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada"
May 20 20:53:05.589509 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.589490    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada"} err="failed to get container status \"9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada\": rpc error: code = NotFound desc = could not find container \"9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada\": container with ID starting with 9fe48112c45af69aceba09f014a5ac3014196b3c22edbb1cacd1e73e80330ada not found: ID does not exist"
May 20 20:53:05.589558 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.589510    2556 scope.go:117] "RemoveContainer" containerID="5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329"
May 20 20:53:05.589737 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.589720    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329"} err="failed to get container status \"5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329\": rpc error: code = NotFound desc = could not find container \"5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329\": container with ID starting with 5f91ed17b03152f0cfbf3da13ec52aa1ef56fe122290a47961116262e9116329 not found: ID does not exist"
May 20 20:53:05.605776 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.605748    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:53:05.606082 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606070    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy-metric"
May 20 20:53:05.606130 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606084    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy-metric"
May 20 20:53:05.606130 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606095    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="config-reloader"
May 20 20:53:05.606130 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606100    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="config-reloader"
May 20 20:53:05.606130 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606107    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="prom-label-proxy"
May 20 20:53:05.606130 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606113    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="prom-label-proxy"
May 20 20:53:05.606130 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606122    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="alertmanager"
May 20 20:53:05.606130 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606129    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="alertmanager"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606146    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy-web"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606152    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy-web"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606161    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="init-config-reloader"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606166    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="init-config-reloader"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606172    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606177    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606226    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy-metric"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606235    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606241    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="config-reloader"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606247    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="prom-label-proxy"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606255    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="kube-rbac-proxy-web"
May 20 20:53:05.606374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.606262    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" containerName="alertmanager"
May 20 20:53:05.611562 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.611548    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.614411 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.614395    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 20 20:53:05.614525 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.614419    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 20 20:53:05.614799 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.614777    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 20 20:53:05.614799 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.614777    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 20 20:53:05.614974 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.614954    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 20 20:53:05.615210 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.615193    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 20 20:53:05.615542 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.615524    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 20 20:53:05.615674 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.615658    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ftcwk\""
May 20 20:53:05.615821 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.615808    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 20 20:53:05.620421 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.620401    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 20 20:53:05.625381 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.625360    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:53:05.676488 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.676454    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3202480a-4da4-4e99-8474-cb8ca6912af1" path="/var/lib/kubelet/pods/3202480a-4da4-4e99-8474-cb8ca6912af1/volumes"
May 20 20:53:05.777163 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777123    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-web-config\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777163 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777159    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a77f409-fc3a-4c87-9aca-0f3b17750292-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777389 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777181    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a77f409-fc3a-4c87-9aca-0f3b17750292-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777389 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777318    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777389 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777355    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777389 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777385    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a77f409-fc3a-4c87-9aca-0f3b17750292-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777559 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777413    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777559 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777458    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777559 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a77f409-fc3a-4c87-9aca-0f3b17750292-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777668 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777619    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh2rf\" (UniqueName: \"kubernetes.io/projected/5a77f409-fc3a-4c87-9aca-0f3b17750292-kube-api-access-jh2rf\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777668 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777660    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777739 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777726    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.777775 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.777749    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a77f409-fc3a-4c87-9aca-0f3b17750292-config-out\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.878860 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.878829    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jh2rf\" (UniqueName: \"kubernetes.io/projected/5a77f409-fc3a-4c87-9aca-0f3b17750292-kube-api-access-jh2rf\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.878985 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.878864    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.878985 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.878914    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.878985 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.878934    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a77f409-fc3a-4c87-9aca-0f3b17750292-config-out\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.878985 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.878963    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-web-config\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.879183 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.878989    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a77f409-fc3a-4c87-9aca-0f3b17750292-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.879183 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.879025    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a77f409-fc3a-4c87-9aca-0f3b17750292-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.879183 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.879061    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.879183 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.879098    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.879183 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.879121    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a77f409-fc3a-4c87-9aca-0f3b17750292-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.879183 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.879154    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.879183 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.879179    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.879536 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.879236    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a77f409-fc3a-4c87-9aca-0f3b17750292-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.879661 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.879635    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5a77f409-fc3a-4c87-9aca-0f3b17750292-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.880394 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.880365    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a77f409-fc3a-4c87-9aca-0f3b17750292-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.880969 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.880776    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a77f409-fc3a-4c87-9aca-0f3b17750292-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.881910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.881881    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a77f409-fc3a-4c87-9aca-0f3b17750292-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.882110 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.882091    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.882177 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.882160    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-web-config\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.882330 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.882307    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a77f409-fc3a-4c87-9aca-0f3b17750292-config-out\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.882330 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.882322    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-config-volume\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.882475 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.882361    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.883818 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.883800    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.883895 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.883872    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.883942 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.883926    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5a77f409-fc3a-4c87-9aca-0f3b17750292-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.888939 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.888916    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh2rf\" (UniqueName: \"kubernetes.io/projected/5a77f409-fc3a-4c87-9aca-0f3b17750292-kube-api-access-jh2rf\") pod \"alertmanager-main-0\" (UID: \"5a77f409-fc3a-4c87-9aca-0f3b17750292\") " pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:05.921946 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:05.921920    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 20 20:53:06.060655 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:06.060625    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 20 20:53:06.064261 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:53:06.064236    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a77f409_fc3a_4c87_9aca_0f3b17750292.slice/crio-7458518d258f621a00430dc02dd8686e2be82ed9c3d20ba63bd65dd5a1780445 WatchSource:0}: Error finding container 7458518d258f621a00430dc02dd8686e2be82ed9c3d20ba63bd65dd5a1780445: Status 404 returned error can't find the container with id 7458518d258f621a00430dc02dd8686e2be82ed9c3d20ba63bd65dd5a1780445
May 20 20:53:06.543477 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:06.543416    2556 generic.go:358] "Generic (PLEG): container finished" podID="5a77f409-fc3a-4c87-9aca-0f3b17750292" containerID="1452c6b78ba55764c07b2e39dec0e6a3b4d21b4d60180cb7470d1c4e12200292" exitCode=0
May 20 20:53:06.543620 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:06.543481    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a77f409-fc3a-4c87-9aca-0f3b17750292","Type":"ContainerDied","Data":"1452c6b78ba55764c07b2e39dec0e6a3b4d21b4d60180cb7470d1c4e12200292"}
May 20 20:53:06.543620 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:06.543509    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a77f409-fc3a-4c87-9aca-0f3b17750292","Type":"ContainerStarted","Data":"7458518d258f621a00430dc02dd8686e2be82ed9c3d20ba63bd65dd5a1780445"}
May 20 20:53:07.549578 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:07.549534    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a77f409-fc3a-4c87-9aca-0f3b17750292","Type":"ContainerStarted","Data":"9bc6a2f4e1e3147222265991d3703de8cd47c7e9858aefdac6a2f5192202c37a"}
May 20 20:53:07.549578 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:07.549581    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a77f409-fc3a-4c87-9aca-0f3b17750292","Type":"ContainerStarted","Data":"aba6b0c470e43ebf19f08ac7f62114ac41592c42666fd7aecbc04cb1535bc658"}
May 20 20:53:07.550044 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:07.549594    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a77f409-fc3a-4c87-9aca-0f3b17750292","Type":"ContainerStarted","Data":"d7f386be7f03c39fa4460983484364ebf4686ece1b9b29868883acda25cc96fc"}
May 20 20:53:07.550044 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:07.549606    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a77f409-fc3a-4c87-9aca-0f3b17750292","Type":"ContainerStarted","Data":"91a1f8a28e06f7c7377f298753109b59397ce32e5ecab7e8f5dd90baad7215f5"}
May 20 20:53:07.550044 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:07.549616    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a77f409-fc3a-4c87-9aca-0f3b17750292","Type":"ContainerStarted","Data":"f79608399fd2cc5d2b7ff5784576b7e7f1ca0fcfbaa2ec2e4db31b9b1781fe73"}
May 20 20:53:07.550044 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:07.549626    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5a77f409-fc3a-4c87-9aca-0f3b17750292","Type":"ContainerStarted","Data":"217b53dde0334810f700fc47390a8b29e849c250c5bb31d4145949d4c8b33438"}
May 20 20:53:07.582311 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:07.582241    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.582227189 podStartE2EDuration="2.582227189s" podCreationTimestamp="2026-05-20 20:53:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:53:07.581366185 +0000 UTC m=+260.510962926" watchObservedRunningTime="2026-05-20 20:53:07.582227189 +0000 UTC m=+260.511823927"
May 20 20:53:11.964947 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:11.964917    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:11.965301 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:11.964960    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:11.969525 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:11.969504    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:12.567524 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:12.567488    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65964847cc-jrr69"
May 20 20:53:12.629203 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:12.629171    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844d9c6b4d-blmt5"]
May 20 20:53:37.648635 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.648572    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-844d9c6b4d-blmt5" podUID="9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" containerName="console" containerID="cri-o://6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a" gracePeriod=15
May 20 20:53:37.890121 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.890100    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-844d9c6b4d-blmt5_9ed92c04-da5d-4f2e-a6ee-598c9ca8f267/console/0.log"
May 20 20:53:37.890230 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.890165    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:53:37.936971 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.936907    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-oauth-serving-cert\") pod \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") "
May 20 20:53:37.936971 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.936934    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-trusted-ca-bundle\") pod \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") "
May 20 20:53:37.936971 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.936962    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-serving-cert\") pod \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") "
May 20 20:53:37.937191 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.936986    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-config\") pod \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") "
May 20 20:53:37.937191 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.937039    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-service-ca\") pod \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") "
May 20 20:53:37.937191 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.937085    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-oauth-config\") pod \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") "
May 20 20:53:37.937309 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.937244    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n25bb\" (UniqueName: \"kubernetes.io/projected/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-kube-api-access-n25bb\") pod \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\" (UID: \"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267\") "
May 20 20:53:37.937309 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.937257    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" (UID: "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:53:37.937377 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.937333    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" (UID: "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:53:37.937576 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.937554    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-oauth-serving-cert\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:37.937681 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.937578    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-trusted-ca-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:37.937681 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.937663    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-config" (OuterVolumeSpecName: "console-config") pod "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" (UID: "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:53:37.937762 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.937672    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-service-ca" (OuterVolumeSpecName: "service-ca") pod "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" (UID: "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:53:37.939330 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.939302    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" (UID: "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:37.939419 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.939393    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" (UID: "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:53:37.939486 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:37.939422    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-kube-api-access-n25bb" (OuterVolumeSpecName: "kube-api-access-n25bb") pod "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" (UID: "9ed92c04-da5d-4f2e-a6ee-598c9ca8f267"). InnerVolumeSpecName "kube-api-access-n25bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:53:38.038419 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.038368    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-serving-cert\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:38.038419 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.038413    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-config\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:38.038419 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.038423    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-service-ca\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:38.038419 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.038452    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-console-oauth-config\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:38.038698 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.038462    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n25bb\" (UniqueName: \"kubernetes.io/projected/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267-kube-api-access-n25bb\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:53:38.643761 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.643732    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-844d9c6b4d-blmt5_9ed92c04-da5d-4f2e-a6ee-598c9ca8f267/console/0.log"
May 20 20:53:38.643937 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.643771    2556 generic.go:358] "Generic (PLEG): container finished" podID="9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" containerID="6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a" exitCode=2
May 20 20:53:38.643937 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.643825    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844d9c6b4d-blmt5" event={"ID":"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267","Type":"ContainerDied","Data":"6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a"}
May 20 20:53:38.643937 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.643838    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844d9c6b4d-blmt5"
May 20 20:53:38.643937 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.643857    2556 scope.go:117] "RemoveContainer" containerID="6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a"
May 20 20:53:38.643937 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.643847    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844d9c6b4d-blmt5" event={"ID":"9ed92c04-da5d-4f2e-a6ee-598c9ca8f267","Type":"ContainerDied","Data":"a755d1202822def1c279ba36aced435c8f9c1e0278e8add87c849ce382627d96"}
May 20 20:53:38.653542 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.653321    2556 scope.go:117] "RemoveContainer" containerID="6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a"
May 20 20:53:38.653764 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:53:38.653615    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a\": container with ID starting with 6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a not found: ID does not exist" containerID="6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a"
May 20 20:53:38.653764 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.653638    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a"} err="failed to get container status \"6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a\": rpc error: code = NotFound desc = could not find container \"6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a\": container with ID starting with 6a167bb4eb8afd65f0abcae23f10567a3e6b0f6ba90281e5b3715bcb2ec81b6a not found: ID does not exist"
May 20 20:53:38.676238 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.676207    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844d9c6b4d-blmt5"]
May 20 20:53:38.679947 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:38.679922    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-844d9c6b4d-blmt5"]
May 20 20:53:39.674731 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:39.674691    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" path="/var/lib/kubelet/pods/9ed92c04-da5d-4f2e-a6ee-598c9ca8f267/volumes"
May 20 20:53:44.752593 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.752554    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-s8r5d"]
May 20 20:53:44.752961 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.752846    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" containerName="console"
May 20 20:53:44.752961 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.752857    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" containerName="console"
May 20 20:53:44.752961 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.752931    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ed92c04-da5d-4f2e-a6ee-598c9ca8f267" containerName="console"
May 20 20:53:44.757522 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.757504    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8r5d"
May 20 20:53:44.760797 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.760780    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 20:53:44.769511 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.769487    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s8r5d"]
May 20 20:53:44.891999 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.891965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e790382a-2ad5-40e0-82e1-ed7df94e4d0e-original-pull-secret\") pod \"global-pull-secret-syncer-s8r5d\" (UID: \"e790382a-2ad5-40e0-82e1-ed7df94e4d0e\") " pod="kube-system/global-pull-secret-syncer-s8r5d"
May 20 20:53:44.892190 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.892020    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e790382a-2ad5-40e0-82e1-ed7df94e4d0e-dbus\") pod \"global-pull-secret-syncer-s8r5d\" (UID: \"e790382a-2ad5-40e0-82e1-ed7df94e4d0e\") " pod="kube-system/global-pull-secret-syncer-s8r5d"
May 20 20:53:44.892190 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.892079    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e790382a-2ad5-40e0-82e1-ed7df94e4d0e-kubelet-config\") pod \"global-pull-secret-syncer-s8r5d\" (UID: \"e790382a-2ad5-40e0-82e1-ed7df94e4d0e\") " pod="kube-system/global-pull-secret-syncer-s8r5d"
May 20 20:53:44.993450 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.993401    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e790382a-2ad5-40e0-82e1-ed7df94e4d0e-dbus\") pod \"global-pull-secret-syncer-s8r5d\" (UID: \"e790382a-2ad5-40e0-82e1-ed7df94e4d0e\") " pod="kube-system/global-pull-secret-syncer-s8r5d"
May 20 20:53:44.993582 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.993453    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e790382a-2ad5-40e0-82e1-ed7df94e4d0e-kubelet-config\") pod \"global-pull-secret-syncer-s8r5d\" (UID: \"e790382a-2ad5-40e0-82e1-ed7df94e4d0e\") " pod="kube-system/global-pull-secret-syncer-s8r5d"
May 20 20:53:44.993582 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.993500    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e790382a-2ad5-40e0-82e1-ed7df94e4d0e-original-pull-secret\") pod \"global-pull-secret-syncer-s8r5d\" (UID: \"e790382a-2ad5-40e0-82e1-ed7df94e4d0e\") " pod="kube-system/global-pull-secret-syncer-s8r5d"
May 20 20:53:44.993655 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.993578    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e790382a-2ad5-40e0-82e1-ed7df94e4d0e-dbus\") pod \"global-pull-secret-syncer-s8r5d\" (UID: \"e790382a-2ad5-40e0-82e1-ed7df94e4d0e\") " pod="kube-system/global-pull-secret-syncer-s8r5d"
May 20 20:53:44.993655 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.993591    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e790382a-2ad5-40e0-82e1-ed7df94e4d0e-kubelet-config\") pod \"global-pull-secret-syncer-s8r5d\" (UID: \"e790382a-2ad5-40e0-82e1-ed7df94e4d0e\") " pod="kube-system/global-pull-secret-syncer-s8r5d"
May 20 20:53:44.995686 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:44.995666    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e790382a-2ad5-40e0-82e1-ed7df94e4d0e-original-pull-secret\") pod \"global-pull-secret-syncer-s8r5d\" (UID: \"e790382a-2ad5-40e0-82e1-ed7df94e4d0e\") " pod="kube-system/global-pull-secret-syncer-s8r5d"
May 20 20:53:45.066538 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:45.066462    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8r5d"
May 20 20:53:45.194829 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:45.194780    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s8r5d"]
May 20 20:53:45.199362 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:53:45.199335    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode790382a_2ad5_40e0_82e1_ed7df94e4d0e.slice/crio-d547a6056aef8dc490b8e9e5cf88dbecdb7ddcffe3e9b8092ba73592ebe1017e WatchSource:0}: Error finding container d547a6056aef8dc490b8e9e5cf88dbecdb7ddcffe3e9b8092ba73592ebe1017e: Status 404 returned error can't find the container with id d547a6056aef8dc490b8e9e5cf88dbecdb7ddcffe3e9b8092ba73592ebe1017e
May 20 20:53:45.664863 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:45.664825    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s8r5d" event={"ID":"e790382a-2ad5-40e0-82e1-ed7df94e4d0e","Type":"ContainerStarted","Data":"d547a6056aef8dc490b8e9e5cf88dbecdb7ddcffe3e9b8092ba73592ebe1017e"}
May 20 20:53:48.900973 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:48.900950    2556 kubelet.go:1628] "Image garbage collection succeeded"
May 20 20:53:49.679583 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:49.679547    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s8r5d" event={"ID":"e790382a-2ad5-40e0-82e1-ed7df94e4d0e","Type":"ContainerStarted","Data":"0bcbd0e859d55e9351eb5dc0dd32ca90897db6182253491fe485c5c127265b38"}
May 20 20:53:49.705170 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:53:49.705116    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s8r5d" podStartSLOduration=1.97734474 podStartE2EDuration="5.705103547s" podCreationTimestamp="2026-05-20 20:53:44 +0000 UTC" firstStartedPulling="2026-05-20 20:53:45.201167733 +0000 UTC m=+298.130764450" lastFinishedPulling="2026-05-20 20:53:48.928926538 +0000 UTC m=+301.858523257" observedRunningTime="2026-05-20 20:53:49.702675053 +0000 UTC m=+302.632271793" watchObservedRunningTime="2026-05-20 20:53:49.705103547 +0000 UTC m=+302.634700286"
May 20 20:54:03.355052 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.355018    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"]
May 20 20:54:03.359591 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.359573    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:03.361939 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.361913    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:54:03.362557 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.362539    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cqs\""
May 20 20:54:03.362631 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.362539    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:54:03.368939 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.368913    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"]
May 20 20:54:03.543981 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.543947    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:03.544168 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.544017    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpznh\" (UniqueName: \"kubernetes.io/projected/b4c9567d-863e-497d-8938-2e9de33f6ac0-kube-api-access-kpznh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:03.544168 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.544078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:03.645031 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.644997    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:03.645217 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.645052    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:03.645217 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.645139    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpznh\" (UniqueName: \"kubernetes.io/projected/b4c9567d-863e-497d-8938-2e9de33f6ac0-kube-api-access-kpznh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:03.645392 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.645368    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:03.645476 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.645395    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:03.655816 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.655796    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpznh\" (UniqueName: \"kubernetes.io/projected/b4c9567d-863e-497d-8938-2e9de33f6ac0-kube-api-access-kpznh\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:03.668724 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.668707    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:03.796565 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.796539    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"]
May 20 20:54:03.798589 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:54:03.798556    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c9567d_863e_497d_8938_2e9de33f6ac0.slice/crio-4d7ce76ad2fbb874063a06eeeada62e4c7f9e4da8a73e36d07f02a9d06dbc732 WatchSource:0}: Error finding container 4d7ce76ad2fbb874063a06eeeada62e4c7f9e4da8a73e36d07f02a9d06dbc732: Status 404 returned error can't find the container with id 4d7ce76ad2fbb874063a06eeeada62e4c7f9e4da8a73e36d07f02a9d06dbc732
May 20 20:54:03.800395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:03.800375    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:54:04.721671 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:04.721638    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5" event={"ID":"b4c9567d-863e-497d-8938-2e9de33f6ac0","Type":"ContainerStarted","Data":"4d7ce76ad2fbb874063a06eeeada62e4c7f9e4da8a73e36d07f02a9d06dbc732"}
May 20 20:54:09.744171 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:09.744137    2556 generic.go:358] "Generic (PLEG): container finished" podID="b4c9567d-863e-497d-8938-2e9de33f6ac0" containerID="2c42e70cdcbf3323fc794e7cd0a425dae9438d44d54cc52ab28997afca38f707" exitCode=0
May 20 20:54:09.744589 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:09.744176    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5" event={"ID":"b4c9567d-863e-497d-8938-2e9de33f6ac0","Type":"ContainerDied","Data":"2c42e70cdcbf3323fc794e7cd0a425dae9438d44d54cc52ab28997afca38f707"}
May 20 20:54:12.755175 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:12.755131    2556 generic.go:358] "Generic (PLEG): container finished" podID="b4c9567d-863e-497d-8938-2e9de33f6ac0" containerID="a318c28470c6677a54d1ad54e923c89f4589dc9352c4b63977bb9b4b74885d2f" exitCode=0
May 20 20:54:12.755625 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:12.755220    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5" event={"ID":"b4c9567d-863e-497d-8938-2e9de33f6ac0","Type":"ContainerDied","Data":"a318c28470c6677a54d1ad54e923c89f4589dc9352c4b63977bb9b4b74885d2f"}
May 20 20:54:18.777930 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:18.777897    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5" event={"ID":"b4c9567d-863e-497d-8938-2e9de33f6ac0","Type":"ContainerStarted","Data":"6f272f34702ed4af4ec8bf1a73c66c4421a3e97932175447769261b917c887ba"}
May 20 20:54:18.801664 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:18.801621    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5" podStartSLOduration=0.906349245 podStartE2EDuration="15.801607519s" podCreationTimestamp="2026-05-20 20:54:03 +0000 UTC" firstStartedPulling="2026-05-20 20:54:03.800557576 +0000 UTC m=+316.730154294" lastFinishedPulling="2026-05-20 20:54:18.695815846 +0000 UTC m=+331.625412568" observedRunningTime="2026-05-20 20:54:18.801307877 +0000 UTC m=+331.730904616" watchObservedRunningTime="2026-05-20 20:54:18.801607519 +0000 UTC m=+331.731204258"
May 20 20:54:19.782906 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:19.782875    2556 generic.go:358] "Generic (PLEG): container finished" podID="b4c9567d-863e-497d-8938-2e9de33f6ac0" containerID="6f272f34702ed4af4ec8bf1a73c66c4421a3e97932175447769261b917c887ba" exitCode=0
May 20 20:54:19.783293 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:19.782913    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5" event={"ID":"b4c9567d-863e-497d-8938-2e9de33f6ac0","Type":"ContainerDied","Data":"6f272f34702ed4af4ec8bf1a73c66c4421a3e97932175447769261b917c887ba"}
May 20 20:54:20.910539 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:20.910513    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:20.989778 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:20.989746    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-bundle\") pod \"b4c9567d-863e-497d-8938-2e9de33f6ac0\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") "
May 20 20:54:20.989917 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:20.989799    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-util\") pod \"b4c9567d-863e-497d-8938-2e9de33f6ac0\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") "
May 20 20:54:20.989917 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:20.989889    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpznh\" (UniqueName: \"kubernetes.io/projected/b4c9567d-863e-497d-8938-2e9de33f6ac0-kube-api-access-kpznh\") pod \"b4c9567d-863e-497d-8938-2e9de33f6ac0\" (UID: \"b4c9567d-863e-497d-8938-2e9de33f6ac0\") "
May 20 20:54:20.990425 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:20.990402    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-bundle" (OuterVolumeSpecName: "bundle") pod "b4c9567d-863e-497d-8938-2e9de33f6ac0" (UID: "b4c9567d-863e-497d-8938-2e9de33f6ac0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:54:20.992000 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:20.991975    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4c9567d-863e-497d-8938-2e9de33f6ac0-kube-api-access-kpznh" (OuterVolumeSpecName: "kube-api-access-kpznh") pod "b4c9567d-863e-497d-8938-2e9de33f6ac0" (UID: "b4c9567d-863e-497d-8938-2e9de33f6ac0"). InnerVolumeSpecName "kube-api-access-kpznh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:54:20.994495 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:20.994476    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-util" (OuterVolumeSpecName: "util") pod "b4c9567d-863e-497d-8938-2e9de33f6ac0" (UID: "b4c9567d-863e-497d-8938-2e9de33f6ac0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:54:21.090732 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:21.090637    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:54:21.090732 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:21.090676    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpznh\" (UniqueName: \"kubernetes.io/projected/b4c9567d-863e-497d-8938-2e9de33f6ac0-kube-api-access-kpznh\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:54:21.090732 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:21.090688    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b4c9567d-863e-497d-8938-2e9de33f6ac0-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:54:21.791577 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:21.791544    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5" event={"ID":"b4c9567d-863e-497d-8938-2e9de33f6ac0","Type":"ContainerDied","Data":"4d7ce76ad2fbb874063a06eeeada62e4c7f9e4da8a73e36d07f02a9d06dbc732"}
May 20 20:54:21.791577 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:21.791579    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d7ce76ad2fbb874063a06eeeada62e4c7f9e4da8a73e36d07f02a9d06dbc732"
May 20 20:54:21.791815 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:21.791599    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlnxc5"
May 20 20:54:26.068090 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.068062    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427"]
May 20 20:54:26.068573 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.068381    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4c9567d-863e-497d-8938-2e9de33f6ac0" containerName="util"
May 20 20:54:26.068573 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.068396    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4c9567d-863e-497d-8938-2e9de33f6ac0" containerName="util"
May 20 20:54:26.068573 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.068415    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4c9567d-863e-497d-8938-2e9de33f6ac0" containerName="extract"
May 20 20:54:26.068573 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.068421    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4c9567d-863e-497d-8938-2e9de33f6ac0" containerName="extract"
May 20 20:54:26.068573 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.068448    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4c9567d-863e-497d-8938-2e9de33f6ac0" containerName="pull"
May 20 20:54:26.068573 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.068456    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4c9567d-863e-497d-8938-2e9de33f6ac0" containerName="pull"
May 20 20:54:26.068573 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.068511    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4c9567d-863e-497d-8938-2e9de33f6ac0" containerName="extract"
May 20 20:54:26.072669 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.072650    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427"
May 20 20:54:26.077284 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.077263    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rsfjf\""
May 20 20:54:26.077571 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.077551    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 20 20:54:26.077662 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.077557    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 20 20:54:26.088375 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.088345    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427"]
May 20 20:54:26.133906 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.133880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b621e4dd-667b-424b-b055-802de93842c8-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zw427\" (UID: \"b621e4dd-667b-424b-b055-802de93842c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427"
May 20 20:54:26.134018 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.133943    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtcxs\" (UniqueName: \"kubernetes.io/projected/b621e4dd-667b-424b-b055-802de93842c8-kube-api-access-jtcxs\") pod \"cert-manager-operator-controller-manager-54b9655956-zw427\" (UID: \"b621e4dd-667b-424b-b055-802de93842c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427"
May 20 20:54:26.234675 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.234648    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtcxs\" (UniqueName: \"kubernetes.io/projected/b621e4dd-667b-424b-b055-802de93842c8-kube-api-access-jtcxs\") pod \"cert-manager-operator-controller-manager-54b9655956-zw427\" (UID: \"b621e4dd-667b-424b-b055-802de93842c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427"
May 20 20:54:26.234786 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.234690    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b621e4dd-667b-424b-b055-802de93842c8-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zw427\" (UID: \"b621e4dd-667b-424b-b055-802de93842c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427"
May 20 20:54:26.235050 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.235031    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b621e4dd-667b-424b-b055-802de93842c8-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-zw427\" (UID: \"b621e4dd-667b-424b-b055-802de93842c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427"
May 20 20:54:26.254534 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.254512    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtcxs\" (UniqueName: \"kubernetes.io/projected/b621e4dd-667b-424b-b055-802de93842c8-kube-api-access-jtcxs\") pod \"cert-manager-operator-controller-manager-54b9655956-zw427\" (UID: \"b621e4dd-667b-424b-b055-802de93842c8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427"
May 20 20:54:26.382061 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.382004    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427"
May 20 20:54:26.518388 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.518364    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427"]
May 20 20:54:26.521108 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:54:26.521081    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb621e4dd_667b_424b_b055_802de93842c8.slice/crio-e58dfc77ed93ce85ffb3eb4742b1b8b24d660f93698cd0bf52e972ee5f50812c WatchSource:0}: Error finding container e58dfc77ed93ce85ffb3eb4742b1b8b24d660f93698cd0bf52e972ee5f50812c: Status 404 returned error can't find the container with id e58dfc77ed93ce85ffb3eb4742b1b8b24d660f93698cd0bf52e972ee5f50812c
May 20 20:54:26.812915 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:26.812876    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427" event={"ID":"b621e4dd-667b-424b-b055-802de93842c8","Type":"ContainerStarted","Data":"e58dfc77ed93ce85ffb3eb4742b1b8b24d660f93698cd0bf52e972ee5f50812c"}
May 20 20:54:28.822158 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:28.822123    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427" event={"ID":"b621e4dd-667b-424b-b055-802de93842c8","Type":"ContainerStarted","Data":"60b4973e53ed18399a334d46092e04e5ca869a7c3548c58fa8028baa9a2104f8"}
May 20 20:54:28.846712 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:28.846667    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-zw427" podStartSLOduration=1.113610569 podStartE2EDuration="2.846650132s" podCreationTimestamp="2026-05-20 20:54:26 +0000 UTC" firstStartedPulling="2026-05-20 20:54:26.527174303 +0000 UTC m=+339.456771020" lastFinishedPulling="2026-05-20 20:54:28.260213866 +0000 UTC m=+341.189810583" observedRunningTime="2026-05-20 20:54:28.844182584 +0000 UTC m=+341.773779323" watchObservedRunningTime="2026-05-20 20:54:28.846650132 +0000 UTC m=+341.776246872"
May 20 20:54:30.168207 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.168172    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"]
May 20 20:54:30.171680 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.171664    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:30.174840 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.174820    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:54:30.175580 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.175558    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:54:30.175772 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.175589    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cqs\""
May 20 20:54:30.182578 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.182557    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"]
May 20 20:54:30.273060 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.273022    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:30.273060 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.273062    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhjd8\" (UniqueName: \"kubernetes.io/projected/fca4b401-a9d6-4041-b0c1-10cacdab7265-kube-api-access-vhjd8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:30.273311 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.273161    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:30.373848 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.373811    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:30.374037 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.373895    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:30.374037 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.373921    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhjd8\" (UniqueName: \"kubernetes.io/projected/fca4b401-a9d6-4041-b0c1-10cacdab7265-kube-api-access-vhjd8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:30.374279 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.374251    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:30.374347 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.374259    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:30.394352 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.394319    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhjd8\" (UniqueName: \"kubernetes.io/projected/fca4b401-a9d6-4041-b0c1-10cacdab7265-kube-api-access-vhjd8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:30.481220 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.481136    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:30.617566 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.613799    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"]
May 20 20:54:30.830706 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.830614    2556 generic.go:358] "Generic (PLEG): container finished" podID="fca4b401-a9d6-4041-b0c1-10cacdab7265" containerID="e252417019845e6e4990d78a225f82f1325db461595ea1c0e0474bef239a38e1" exitCode=0
May 20 20:54:30.830840 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.830704    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp" event={"ID":"fca4b401-a9d6-4041-b0c1-10cacdab7265","Type":"ContainerDied","Data":"e252417019845e6e4990d78a225f82f1325db461595ea1c0e0474bef239a38e1"}
May 20 20:54:30.830840 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:30.830744    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp" event={"ID":"fca4b401-a9d6-4041-b0c1-10cacdab7265","Type":"ContainerStarted","Data":"6f56854852aaf121ed7e2d052a64fc53eb6722185f5ccedda581788644718490"}
May 20 20:54:33.260728 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.260696    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6pf9v"]
May 20 20:54:33.263918 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.263898    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-6pf9v"
May 20 20:54:33.266449 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.266416    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qtjr8\""
May 20 20:54:33.266594 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.266462    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 20 20:54:33.267238 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.267222    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 20 20:54:33.273153 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.273131    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6pf9v"]
May 20 20:54:33.405697 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.405661    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92c77051-1852-4645-81e0-3e18c6fd2bfa-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6pf9v\" (UID: \"92c77051-1852-4645-81e0-3e18c6fd2bfa\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6pf9v"
May 20 20:54:33.405901 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.405721    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qb8n\" (UniqueName: \"kubernetes.io/projected/92c77051-1852-4645-81e0-3e18c6fd2bfa-kube-api-access-2qb8n\") pod \"cert-manager-cainjector-68b757865b-6pf9v\" (UID: \"92c77051-1852-4645-81e0-3e18c6fd2bfa\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6pf9v"
May 20 20:54:33.506481 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.506414    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qb8n\" (UniqueName: \"kubernetes.io/projected/92c77051-1852-4645-81e0-3e18c6fd2bfa-kube-api-access-2qb8n\") pod \"cert-manager-cainjector-68b757865b-6pf9v\" (UID: \"92c77051-1852-4645-81e0-3e18c6fd2bfa\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6pf9v"
May 20 20:54:33.506636 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.506540    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92c77051-1852-4645-81e0-3e18c6fd2bfa-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6pf9v\" (UID: \"92c77051-1852-4645-81e0-3e18c6fd2bfa\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6pf9v"
May 20 20:54:33.516721 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.516686    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qb8n\" (UniqueName: \"kubernetes.io/projected/92c77051-1852-4645-81e0-3e18c6fd2bfa-kube-api-access-2qb8n\") pod \"cert-manager-cainjector-68b757865b-6pf9v\" (UID: \"92c77051-1852-4645-81e0-3e18c6fd2bfa\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6pf9v"
May 20 20:54:33.516895 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.516879    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92c77051-1852-4645-81e0-3e18c6fd2bfa-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-6pf9v\" (UID: \"92c77051-1852-4645-81e0-3e18c6fd2bfa\") " pod="cert-manager/cert-manager-cainjector-68b757865b-6pf9v"
May 20 20:54:33.581140 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.581097    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-6pf9v"
May 20 20:54:33.712856 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.712831    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-6pf9v"]
May 20 20:54:33.715260 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:54:33.715226    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92c77051_1852_4645_81e0_3e18c6fd2bfa.slice/crio-0c9107d808022dcc6a44fc0411c130a02a2274af20015c0f9dca459854e16b9b WatchSource:0}: Error finding container 0c9107d808022dcc6a44fc0411c130a02a2274af20015c0f9dca459854e16b9b: Status 404 returned error can't find the container with id 0c9107d808022dcc6a44fc0411c130a02a2274af20015c0f9dca459854e16b9b
May 20 20:54:33.844897 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.844854    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-6pf9v" event={"ID":"92c77051-1852-4645-81e0-3e18c6fd2bfa","Type":"ContainerStarted","Data":"0c9107d808022dcc6a44fc0411c130a02a2274af20015c0f9dca459854e16b9b"}
May 20 20:54:33.846381 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.846359    2556 generic.go:358] "Generic (PLEG): container finished" podID="fca4b401-a9d6-4041-b0c1-10cacdab7265" containerID="374020ca35256487e996b0fa759bb9f793a02d9a68438624d03140a7848764e2" exitCode=0
May 20 20:54:33.846559 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:33.846396    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp" event={"ID":"fca4b401-a9d6-4041-b0c1-10cacdab7265","Type":"ContainerDied","Data":"374020ca35256487e996b0fa759bb9f793a02d9a68438624d03140a7848764e2"}
May 20 20:54:34.480542 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.480505    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-ms95h"]
May 20 20:54:34.484145 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.484120    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h"
May 20 20:54:34.488289 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.488264    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-k778z\""
May 20 20:54:34.494166 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.494137    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-ms95h"]
May 20 20:54:34.615499 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.615463    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bp6m\" (UniqueName: \"kubernetes.io/projected/d8b751ee-9eb7-4866-9105-bd25063bae5a-kube-api-access-7bp6m\") pod \"cert-manager-webhook-587ccfb98-ms95h\" (UID: \"d8b751ee-9eb7-4866-9105-bd25063bae5a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h"
May 20 20:54:34.615676 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.615542    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8b751ee-9eb7-4866-9105-bd25063bae5a-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-ms95h\" (UID: \"d8b751ee-9eb7-4866-9105-bd25063bae5a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h"
May 20 20:54:34.716819 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.716782    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bp6m\" (UniqueName: \"kubernetes.io/projected/d8b751ee-9eb7-4866-9105-bd25063bae5a-kube-api-access-7bp6m\") pod \"cert-manager-webhook-587ccfb98-ms95h\" (UID: \"d8b751ee-9eb7-4866-9105-bd25063bae5a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h"
May 20 20:54:34.717003 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.716957    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8b751ee-9eb7-4866-9105-bd25063bae5a-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-ms95h\" (UID: \"d8b751ee-9eb7-4866-9105-bd25063bae5a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h"
May 20 20:54:34.729501 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.729427    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8b751ee-9eb7-4866-9105-bd25063bae5a-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-ms95h\" (UID: \"d8b751ee-9eb7-4866-9105-bd25063bae5a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h"
May 20 20:54:34.730258 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.730228    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bp6m\" (UniqueName: \"kubernetes.io/projected/d8b751ee-9eb7-4866-9105-bd25063bae5a-kube-api-access-7bp6m\") pod \"cert-manager-webhook-587ccfb98-ms95h\" (UID: \"d8b751ee-9eb7-4866-9105-bd25063bae5a\") " pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h"
May 20 20:54:34.795812 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.795711    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h"
May 20 20:54:34.855619 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.855584    2556 generic.go:358] "Generic (PLEG): container finished" podID="fca4b401-a9d6-4041-b0c1-10cacdab7265" containerID="43ef3c0b6762bee798ed3afa3100fc55c2a0147457ceaa0abe58c6934f4a47b8" exitCode=0
May 20 20:54:34.855715 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.855701    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp" event={"ID":"fca4b401-a9d6-4041-b0c1-10cacdab7265","Type":"ContainerDied","Data":"43ef3c0b6762bee798ed3afa3100fc55c2a0147457ceaa0abe58c6934f4a47b8"}
May 20 20:54:34.958605 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:34.958570    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-ms95h"]
May 20 20:54:34.962013 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:54:34.961981    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8b751ee_9eb7_4866_9105_bd25063bae5a.slice/crio-aec4bd97654ac19687b53b8e2c8e503a9566c826f67d329460f83929a4d7a1fd WatchSource:0}: Error finding container aec4bd97654ac19687b53b8e2c8e503a9566c826f67d329460f83929a4d7a1fd: Status 404 returned error can't find the container with id aec4bd97654ac19687b53b8e2c8e503a9566c826f67d329460f83929a4d7a1fd
May 20 20:54:35.860978 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:35.860929    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h" event={"ID":"d8b751ee-9eb7-4866-9105-bd25063bae5a","Type":"ContainerStarted","Data":"aec4bd97654ac19687b53b8e2c8e503a9566c826f67d329460f83929a4d7a1fd"}
May 20 20:54:36.331252 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.331230    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:36.435189 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.435156    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhjd8\" (UniqueName: \"kubernetes.io/projected/fca4b401-a9d6-4041-b0c1-10cacdab7265-kube-api-access-vhjd8\") pod \"fca4b401-a9d6-4041-b0c1-10cacdab7265\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") "
May 20 20:54:36.435311 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.435246    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-util\") pod \"fca4b401-a9d6-4041-b0c1-10cacdab7265\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") "
May 20 20:54:36.435311 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.435287    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-bundle\") pod \"fca4b401-a9d6-4041-b0c1-10cacdab7265\" (UID: \"fca4b401-a9d6-4041-b0c1-10cacdab7265\") "
May 20 20:54:36.435674 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.435645    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-bundle" (OuterVolumeSpecName: "bundle") pod "fca4b401-a9d6-4041-b0c1-10cacdab7265" (UID: "fca4b401-a9d6-4041-b0c1-10cacdab7265"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:54:36.437465 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.437419    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca4b401-a9d6-4041-b0c1-10cacdab7265-kube-api-access-vhjd8" (OuterVolumeSpecName: "kube-api-access-vhjd8") pod "fca4b401-a9d6-4041-b0c1-10cacdab7265" (UID: "fca4b401-a9d6-4041-b0c1-10cacdab7265"). InnerVolumeSpecName "kube-api-access-vhjd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:54:36.441820 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.441780    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-util" (OuterVolumeSpecName: "util") pod "fca4b401-a9d6-4041-b0c1-10cacdab7265" (UID: "fca4b401-a9d6-4041-b0c1-10cacdab7265"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:54:36.536724 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.536684    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:54:36.536724 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.536719    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca4b401-a9d6-4041-b0c1-10cacdab7265-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:54:36.536946 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.536734    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhjd8\" (UniqueName: \"kubernetes.io/projected/fca4b401-a9d6-4041-b0c1-10cacdab7265-kube-api-access-vhjd8\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:54:36.866800 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.866753    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp" event={"ID":"fca4b401-a9d6-4041-b0c1-10cacdab7265","Type":"ContainerDied","Data":"6f56854852aaf121ed7e2d052a64fc53eb6722185f5ccedda581788644718490"}
May 20 20:54:36.866800 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.866804    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f56854852aaf121ed7e2d052a64fc53eb6722185f5ccedda581788644718490"
May 20 20:54:36.867567 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.866779    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmp6sp"
May 20 20:54:36.868319 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.868291    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h" event={"ID":"d8b751ee-9eb7-4866-9105-bd25063bae5a","Type":"ContainerStarted","Data":"c0847b3a7d5f54497dbd2054fb3e8ab8c68cfd09146996bea2a6b2f960dd823f"}
May 20 20:54:36.868456 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.868330    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h"
May 20 20:54:36.870241 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.870217    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-6pf9v" event={"ID":"92c77051-1852-4645-81e0-3e18c6fd2bfa","Type":"ContainerStarted","Data":"eafb182023e013bef21f8878437bed8165264d64f8ee6ae7ae99ab1783178046"}
May 20 20:54:36.891763 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.891718    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h" podStartSLOduration=1.466962686 podStartE2EDuration="2.891706852s" podCreationTimestamp="2026-05-20 20:54:34 +0000 UTC" firstStartedPulling="2026-05-20 20:54:34.964286224 +0000 UTC m=+347.893882952" lastFinishedPulling="2026-05-20 20:54:36.389030401 +0000 UTC m=+349.318627118" observedRunningTime="2026-05-20 20:54:36.890626543 +0000 UTC m=+349.820223284" watchObservedRunningTime="2026-05-20 20:54:36.891706852 +0000 UTC m=+349.821303591"
May 20 20:54:36.918894 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:36.918851    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-6pf9v" podStartSLOduration=1.240980101 podStartE2EDuration="3.91883923s" podCreationTimestamp="2026-05-20 20:54:33 +0000 UTC" firstStartedPulling="2026-05-20 20:54:33.717071994 +0000 UTC m=+346.646668710" lastFinishedPulling="2026-05-20 20:54:36.394931115 +0000 UTC m=+349.324527839" observedRunningTime="2026-05-20 20:54:36.915934649 +0000 UTC m=+349.845531389" watchObservedRunningTime="2026-05-20 20:54:36.91883923 +0000 UTC m=+349.848435968"
May 20 20:54:42.876631 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:42.876601    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-ms95h"
May 20 20:54:49.556242 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.556202    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"]
May 20 20:54:49.556674 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.556553    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca4b401-a9d6-4041-b0c1-10cacdab7265" containerName="util"
May 20 20:54:49.556674 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.556565    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca4b401-a9d6-4041-b0c1-10cacdab7265" containerName="util"
May 20 20:54:49.556674 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.556582    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca4b401-a9d6-4041-b0c1-10cacdab7265" containerName="pull"
May 20 20:54:49.556674 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.556587    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca4b401-a9d6-4041-b0c1-10cacdab7265" containerName="pull"
May 20 20:54:49.556674 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.556603    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca4b401-a9d6-4041-b0c1-10cacdab7265" containerName="extract"
May 20 20:54:49.556674 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.556609    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca4b401-a9d6-4041-b0c1-10cacdab7265" containerName="extract"
May 20 20:54:49.556674 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.556661    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="fca4b401-a9d6-4041-b0c1-10cacdab7265" containerName="extract"
May 20 20:54:49.560898 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.560879    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:49.564046 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.564027    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:54:49.564337 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.564323    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:54:49.564856 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.564840    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cqs\""
May 20 20:54:49.568367 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.568340    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"]
May 20 20:54:49.745312 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.745278    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:49.745528 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.745342    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:49.745528 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.745368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2trrx\" (UniqueName: \"kubernetes.io/projected/6486819b-39c7-4fd2-b478-da7f3731d672-kube-api-access-2trrx\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:49.846212 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.846104    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:49.846395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.846295    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2trrx\" (UniqueName: \"kubernetes.io/projected/6486819b-39c7-4fd2-b478-da7f3731d672-kube-api-access-2trrx\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:49.846514 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.846406    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:49.846580 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.846507    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:49.846726 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.846708    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:49.856945 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.856919    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2trrx\" (UniqueName: \"kubernetes.io/projected/6486819b-39c7-4fd2-b478-da7f3731d672-kube-api-access-2trrx\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:49.870885 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:49.870861    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:50.004349 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:50.004323    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"]
May 20 20:54:50.006070 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:54:50.006042    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6486819b_39c7_4fd2_b478_da7f3731d672.slice/crio-5e7066f4dcdcee4ac7cf50dfb262bf9239e90fa9c3b608a2500fa6c752359ab6 WatchSource:0}: Error finding container 5e7066f4dcdcee4ac7cf50dfb262bf9239e90fa9c3b608a2500fa6c752359ab6: Status 404 returned error can't find the container with id 5e7066f4dcdcee4ac7cf50dfb262bf9239e90fa9c3b608a2500fa6c752359ab6
May 20 20:54:50.918500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:50.918466    2556 generic.go:358] "Generic (PLEG): container finished" podID="6486819b-39c7-4fd2-b478-da7f3731d672" containerID="3154573841d576b65c0a6f5c69ed637392867527b6ad186af2f0404f7cd62b5c" exitCode=0
May 20 20:54:50.918828 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:50.918515    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz" event={"ID":"6486819b-39c7-4fd2-b478-da7f3731d672","Type":"ContainerDied","Data":"3154573841d576b65c0a6f5c69ed637392867527b6ad186af2f0404f7cd62b5c"}
May 20 20:54:50.918828 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:50.918543    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz" event={"ID":"6486819b-39c7-4fd2-b478-da7f3731d672","Type":"ContainerStarted","Data":"5e7066f4dcdcee4ac7cf50dfb262bf9239e90fa9c3b608a2500fa6c752359ab6"}
May 20 20:54:51.928576 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:51.928538    2556 generic.go:358] "Generic (PLEG): container finished" podID="6486819b-39c7-4fd2-b478-da7f3731d672" containerID="2a317a2172e96ea328f7de842195abd262a219f31a1715d3098580f8c43bc031" exitCode=0
May 20 20:54:51.929100 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:51.928628    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz" event={"ID":"6486819b-39c7-4fd2-b478-da7f3731d672","Type":"ContainerDied","Data":"2a317a2172e96ea328f7de842195abd262a219f31a1715d3098580f8c43bc031"}
May 20 20:54:52.933369 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:52.933338    2556 generic.go:358] "Generic (PLEG): container finished" podID="6486819b-39c7-4fd2-b478-da7f3731d672" containerID="63f0e1d5bd37cea805bb6976261f0ca1ea34fb2c37c893adf5e8d72577a79d99" exitCode=0
May 20 20:54:52.933743 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:52.933391    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz" event={"ID":"6486819b-39c7-4fd2-b478-da7f3731d672","Type":"ContainerDied","Data":"63f0e1d5bd37cea805bb6976261f0ca1ea34fb2c37c893adf5e8d72577a79d99"}
May 20 20:54:54.062178 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.062152    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:54.183203 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.183173    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-util\") pod \"6486819b-39c7-4fd2-b478-da7f3731d672\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") "
May 20 20:54:54.183368 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.183214    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-bundle\") pod \"6486819b-39c7-4fd2-b478-da7f3731d672\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") "
May 20 20:54:54.183368 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.183252    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2trrx\" (UniqueName: \"kubernetes.io/projected/6486819b-39c7-4fd2-b478-da7f3731d672-kube-api-access-2trrx\") pod \"6486819b-39c7-4fd2-b478-da7f3731d672\" (UID: \"6486819b-39c7-4fd2-b478-da7f3731d672\") "
May 20 20:54:54.183915 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.183889    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-bundle" (OuterVolumeSpecName: "bundle") pod "6486819b-39c7-4fd2-b478-da7f3731d672" (UID: "6486819b-39c7-4fd2-b478-da7f3731d672"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:54:54.185316 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.185288    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6486819b-39c7-4fd2-b478-da7f3731d672-kube-api-access-2trrx" (OuterVolumeSpecName: "kube-api-access-2trrx") pod "6486819b-39c7-4fd2-b478-da7f3731d672" (UID: "6486819b-39c7-4fd2-b478-da7f3731d672"). InnerVolumeSpecName "kube-api-access-2trrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:54:54.189081 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.189032    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-util" (OuterVolumeSpecName: "util") pod "6486819b-39c7-4fd2-b478-da7f3731d672" (UID: "6486819b-39c7-4fd2-b478-da7f3731d672"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:54:54.283927 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.283890    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:54:54.283927 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.283923    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6486819b-39c7-4fd2-b478-da7f3731d672-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:54:54.284096 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.283936    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2trrx\" (UniqueName: \"kubernetes.io/projected/6486819b-39c7-4fd2-b478-da7f3731d672-kube-api-access-2trrx\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:54:54.941420 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.941391    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz"
May 20 20:54:54.941602 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.941384    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5q4zcz" event={"ID":"6486819b-39c7-4fd2-b478-da7f3731d672","Type":"ContainerDied","Data":"5e7066f4dcdcee4ac7cf50dfb262bf9239e90fa9c3b608a2500fa6c752359ab6"}
May 20 20:54:54.941602 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:54.941466    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e7066f4dcdcee4ac7cf50dfb262bf9239e90fa9c3b608a2500fa6c752359ab6"
May 20 20:54:59.640222 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.640188    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"]
May 20 20:54:59.640633 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.640566    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6486819b-39c7-4fd2-b478-da7f3731d672" containerName="pull"
May 20 20:54:59.640633 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.640579    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6486819b-39c7-4fd2-b478-da7f3731d672" containerName="pull"
May 20 20:54:59.640633 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.640589    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6486819b-39c7-4fd2-b478-da7f3731d672" containerName="util"
May 20 20:54:59.640633 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.640595    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6486819b-39c7-4fd2-b478-da7f3731d672" containerName="util"
May 20 20:54:59.640633 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.640605    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6486819b-39c7-4fd2-b478-da7f3731d672" containerName="extract"
May 20 20:54:59.640633 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.640614    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6486819b-39c7-4fd2-b478-da7f3731d672" containerName="extract"
May 20 20:54:59.640832 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.640666    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="6486819b-39c7-4fd2-b478-da7f3731d672" containerName="extract"
May 20 20:54:59.643594 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.643577    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.647233 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.647207    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 20 20:54:59.647361 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.647296    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 20 20:54:59.648341 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.648325    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 20 20:54:59.648475 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.648408    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 20 20:54:59.648475 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.648427    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 20 20:54:59.648475 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.648461    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s9zdv\""
May 20 20:54:59.655677 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.655655    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"]
May 20 20:54:59.724234 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.724169    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/757c80eb-6191-4da2-9743-701cc6164258-manager-config\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.724453 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.724254    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/757c80eb-6191-4da2-9743-701cc6164258-metrics-cert\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.724453 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.724297    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/757c80eb-6191-4da2-9743-701cc6164258-cert\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.724453 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.724371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb6jl\" (UniqueName: \"kubernetes.io/projected/757c80eb-6191-4da2-9743-701cc6164258-kube-api-access-qb6jl\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.825018 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.824984    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/757c80eb-6191-4da2-9743-701cc6164258-cert\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.825153 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.825029    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qb6jl\" (UniqueName: \"kubernetes.io/projected/757c80eb-6191-4da2-9743-701cc6164258-kube-api-access-qb6jl\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.825153 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.825076    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/757c80eb-6191-4da2-9743-701cc6164258-manager-config\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.825153 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.825102    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/757c80eb-6191-4da2-9743-701cc6164258-metrics-cert\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.825795 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.825770    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/757c80eb-6191-4da2-9743-701cc6164258-manager-config\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.827522 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.827496    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/757c80eb-6191-4da2-9743-701cc6164258-cert\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.827592 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.827572    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/757c80eb-6191-4da2-9743-701cc6164258-metrics-cert\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.841712 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.841688    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb6jl\" (UniqueName: \"kubernetes.io/projected/757c80eb-6191-4da2-9743-701cc6164258-kube-api-access-qb6jl\") pod \"lws-controller-manager-d8d69f6f7-7nc4h\" (UID: \"757c80eb-6191-4da2-9743-701cc6164258\") " pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:54:59.953312 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:54:59.953244    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:55:00.099047 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:00.099022    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"]
May 20 20:55:00.101326 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:55:00.101299    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod757c80eb_6191_4da2_9743_701cc6164258.slice/crio-685596b19a4dea957c544463425c00b4f589aa298f474ecd94b487a4f7e127f6 WatchSource:0}: Error finding container 685596b19a4dea957c544463425c00b4f589aa298f474ecd94b487a4f7e127f6: Status 404 returned error can't find the container with id 685596b19a4dea957c544463425c00b4f589aa298f474ecd94b487a4f7e127f6
May 20 20:55:00.964367 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:00.964327    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h" event={"ID":"757c80eb-6191-4da2-9743-701cc6164258","Type":"ContainerStarted","Data":"685596b19a4dea957c544463425c00b4f589aa298f474ecd94b487a4f7e127f6"}
May 20 20:55:01.969641 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:01.969613    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h" event={"ID":"757c80eb-6191-4da2-9743-701cc6164258","Type":"ContainerStarted","Data":"2257ed90bf88c8eda274948faa9a8d1666c15844b071a20d06c23d10f0af6125"}
May 20 20:55:01.969948 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:01.969670    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:55:01.993291 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:01.993236    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h" podStartSLOduration=1.230716537 podStartE2EDuration="2.993219174s" podCreationTimestamp="2026-05-20 20:54:59 +0000 UTC" firstStartedPulling="2026-05-20 20:55:00.10327509 +0000 UTC m=+373.032871807" lastFinishedPulling="2026-05-20 20:55:01.865777712 +0000 UTC m=+374.795374444" observedRunningTime="2026-05-20 20:55:01.991895449 +0000 UTC m=+374.921492187" watchObservedRunningTime="2026-05-20 20:55:01.993219174 +0000 UTC m=+374.922815916"
May 20 20:55:06.383409 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.383376    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"]
May 20 20:55:06.407610 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.407571    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"]
May 20 20:55:06.407759 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.407691    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:06.410746 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.410724    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:55:06.411564 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.411546    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cqs\""
May 20 20:55:06.411844 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.411827    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:55:06.480336 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.480304    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r26m\" (UniqueName: \"kubernetes.io/projected/9f4308ca-07da-44d9-8389-23de8578edac-kube-api-access-5r26m\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:06.480483 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.480355    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:06.480483 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.480388    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:06.580799 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.580769    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5r26m\" (UniqueName: \"kubernetes.io/projected/9f4308ca-07da-44d9-8389-23de8578edac-kube-api-access-5r26m\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:06.580984 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.580823    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:06.580984 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.580947    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:06.581227 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.581194    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:06.581360 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.581291    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:06.598155 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.598130    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r26m\" (UniqueName: \"kubernetes.io/projected/9f4308ca-07da-44d9-8389-23de8578edac-kube-api-access-5r26m\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:06.718247 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.718216    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:06.853391 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.853361    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"]
May 20 20:55:06.854898 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:55:06.854868    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4308ca_07da_44d9_8389_23de8578edac.slice/crio-4f5891d3d9df71b563c652db06f378155bedf1bbc0893dab1319b985f506583c WatchSource:0}: Error finding container 4f5891d3d9df71b563c652db06f378155bedf1bbc0893dab1319b985f506583c: Status 404 returned error can't find the container with id 4f5891d3d9df71b563c652db06f378155bedf1bbc0893dab1319b985f506583c
May 20 20:55:06.988262 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.988199    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr" event={"ID":"9f4308ca-07da-44d9-8389-23de8578edac","Type":"ContainerStarted","Data":"721788a5b216ce26193844e5f0783389d62739a1ead090c50d93c4156b8017ea"}
May 20 20:55:06.988262 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:06.988233    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr" event={"ID":"9f4308ca-07da-44d9-8389-23de8578edac","Type":"ContainerStarted","Data":"4f5891d3d9df71b563c652db06f378155bedf1bbc0893dab1319b985f506583c"}
May 20 20:55:07.103998 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.103972    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"]
May 20 20:55:07.106048 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.106027    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:07.109285 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.109258    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9czfm\""
May 20 20:55:07.109597 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.109579    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 20 20:55:07.109718 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.109590    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 20 20:55:07.109797 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.109720    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 20 20:55:07.109882 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.109863    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 20 20:55:07.125847 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.125825    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"]
May 20 20:55:07.186654 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.186633    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdwqx\" (UniqueName: \"kubernetes.io/projected/ee799f6b-6177-4a2d-86e2-6fc02d325435-kube-api-access-xdwqx\") pod \"opendatahub-operator-controller-manager-6d5db49587-6mwxx\" (UID: \"ee799f6b-6177-4a2d-86e2-6fc02d325435\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:07.186764 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.186673    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee799f6b-6177-4a2d-86e2-6fc02d325435-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-6mwxx\" (UID: \"ee799f6b-6177-4a2d-86e2-6fc02d325435\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:07.186842 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.186783    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee799f6b-6177-4a2d-86e2-6fc02d325435-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-6mwxx\" (UID: \"ee799f6b-6177-4a2d-86e2-6fc02d325435\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:07.287212 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.287142    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee799f6b-6177-4a2d-86e2-6fc02d325435-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-6mwxx\" (UID: \"ee799f6b-6177-4a2d-86e2-6fc02d325435\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:07.287321 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.287241    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee799f6b-6177-4a2d-86e2-6fc02d325435-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-6mwxx\" (UID: \"ee799f6b-6177-4a2d-86e2-6fc02d325435\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:07.287321 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.287293    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdwqx\" (UniqueName: \"kubernetes.io/projected/ee799f6b-6177-4a2d-86e2-6fc02d325435-kube-api-access-xdwqx\") pod \"opendatahub-operator-controller-manager-6d5db49587-6mwxx\" (UID: \"ee799f6b-6177-4a2d-86e2-6fc02d325435\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:07.289579 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.289559    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee799f6b-6177-4a2d-86e2-6fc02d325435-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-6mwxx\" (UID: \"ee799f6b-6177-4a2d-86e2-6fc02d325435\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:07.289660 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.289588    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee799f6b-6177-4a2d-86e2-6fc02d325435-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d5db49587-6mwxx\" (UID: \"ee799f6b-6177-4a2d-86e2-6fc02d325435\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:07.296283 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.296261    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdwqx\" (UniqueName: \"kubernetes.io/projected/ee799f6b-6177-4a2d-86e2-6fc02d325435-kube-api-access-xdwqx\") pod \"opendatahub-operator-controller-manager-6d5db49587-6mwxx\" (UID: \"ee799f6b-6177-4a2d-86e2-6fc02d325435\") " pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:07.416546 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.416523    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:07.557036 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.557009    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"]
May 20 20:55:07.557264 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:55:07.557243    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee799f6b_6177_4a2d_86e2_6fc02d325435.slice/crio-1321df5c50008ca581f4230bc2b22b0209948f646d95eb28d557db2dac8b325d WatchSource:0}: Error finding container 1321df5c50008ca581f4230bc2b22b0209948f646d95eb28d557db2dac8b325d: Status 404 returned error can't find the container with id 1321df5c50008ca581f4230bc2b22b0209948f646d95eb28d557db2dac8b325d
May 20 20:55:07.992311 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.992271    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx" event={"ID":"ee799f6b-6177-4a2d-86e2-6fc02d325435","Type":"ContainerStarted","Data":"1321df5c50008ca581f4230bc2b22b0209948f646d95eb28d557db2dac8b325d"}
May 20 20:55:07.993680 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.993649    2556 generic.go:358] "Generic (PLEG): container finished" podID="9f4308ca-07da-44d9-8389-23de8578edac" containerID="721788a5b216ce26193844e5f0783389d62739a1ead090c50d93c4156b8017ea" exitCode=0
May 20 20:55:07.993803 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:07.993683    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr" event={"ID":"9f4308ca-07da-44d9-8389-23de8578edac","Type":"ContainerDied","Data":"721788a5b216ce26193844e5f0783389d62739a1ead090c50d93c4156b8017ea"}
May 20 20:55:08.999473 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:08.999416    2556 generic.go:358] "Generic (PLEG): container finished" podID="9f4308ca-07da-44d9-8389-23de8578edac" containerID="00d3b20d2f0874f0f2a6b5ea6cbcaa6e2c35a939f09d57b759b3052d242da31f" exitCode=0
May 20 20:55:08.999925 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:08.999517    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr" event={"ID":"9f4308ca-07da-44d9-8389-23de8578edac","Type":"ContainerDied","Data":"00d3b20d2f0874f0f2a6b5ea6cbcaa6e2c35a939f09d57b759b3052d242da31f"}
May 20 20:55:11.009505 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:11.009465    2556 generic.go:358] "Generic (PLEG): container finished" podID="9f4308ca-07da-44d9-8389-23de8578edac" containerID="289957146acfe362f0806d7b11ed139217bde623081247b961dee9bd9ad42c6a" exitCode=0
May 20 20:55:11.009945 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:11.009545    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr" event={"ID":"9f4308ca-07da-44d9-8389-23de8578edac","Type":"ContainerDied","Data":"289957146acfe362f0806d7b11ed139217bde623081247b961dee9bd9ad42c6a"}
May 20 20:55:11.010939 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:11.010920    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx" event={"ID":"ee799f6b-6177-4a2d-86e2-6fc02d325435","Type":"ContainerStarted","Data":"0680918bffd5713b1eaa5d4876c7978d23e5b6c365e693ef532ba0ba6af4df81"}
May 20 20:55:11.011042 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:11.011018    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:11.062347 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:11.062233    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx" podStartSLOduration=1.540918121 podStartE2EDuration="4.06221536s" podCreationTimestamp="2026-05-20 20:55:07 +0000 UTC" firstStartedPulling="2026-05-20 20:55:07.559050021 +0000 UTC m=+380.488646738" lastFinishedPulling="2026-05-20 20:55:10.08034726 +0000 UTC m=+383.009943977" observedRunningTime="2026-05-20 20:55:11.061547096 +0000 UTC m=+383.991143838" watchObservedRunningTime="2026-05-20 20:55:11.06221536 +0000 UTC m=+383.991812100"
May 20 20:55:12.141248 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:12.141222    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:12.232925 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:12.232893    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-util\") pod \"9f4308ca-07da-44d9-8389-23de8578edac\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") "
May 20 20:55:12.233108 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:12.232990    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r26m\" (UniqueName: \"kubernetes.io/projected/9f4308ca-07da-44d9-8389-23de8578edac-kube-api-access-5r26m\") pod \"9f4308ca-07da-44d9-8389-23de8578edac\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") "
May 20 20:55:12.233108 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:12.233010    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-bundle\") pod \"9f4308ca-07da-44d9-8389-23de8578edac\" (UID: \"9f4308ca-07da-44d9-8389-23de8578edac\") "
May 20 20:55:12.233917 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:12.233892    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-bundle" (OuterVolumeSpecName: "bundle") pod "9f4308ca-07da-44d9-8389-23de8578edac" (UID: "9f4308ca-07da-44d9-8389-23de8578edac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:55:12.235066 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:12.235036    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f4308ca-07da-44d9-8389-23de8578edac-kube-api-access-5r26m" (OuterVolumeSpecName: "kube-api-access-5r26m") pod "9f4308ca-07da-44d9-8389-23de8578edac" (UID: "9f4308ca-07da-44d9-8389-23de8578edac"). InnerVolumeSpecName "kube-api-access-5r26m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:55:12.237063 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:12.237029    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-util" (OuterVolumeSpecName: "util") pod "9f4308ca-07da-44d9-8389-23de8578edac" (UID: "9f4308ca-07da-44d9-8389-23de8578edac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:55:12.334362 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:12.334278    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r26m\" (UniqueName: \"kubernetes.io/projected/9f4308ca-07da-44d9-8389-23de8578edac-kube-api-access-5r26m\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:55:12.334362 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:12.334307    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:55:12.334362 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:12.334318    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f4308ca-07da-44d9-8389-23de8578edac-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:55:12.974679 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:12.974649    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d8d69f6f7-7nc4h"
May 20 20:55:13.021413 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:13.021381    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr" event={"ID":"9f4308ca-07da-44d9-8389-23de8578edac","Type":"ContainerDied","Data":"4f5891d3d9df71b563c652db06f378155bedf1bbc0893dab1319b985f506583c"}
May 20 20:55:13.021413 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:13.021406    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9xf9pr"
May 20 20:55:13.021680 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:13.021413    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f5891d3d9df71b563c652db06f378155bedf1bbc0893dab1319b985f506583c"
May 20 20:55:22.017379 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:22.017346    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d5db49587-6mwxx"
May 20 20:55:25.370931 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.370851    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"]
May 20 20:55:25.371378 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.371358    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f4308ca-07da-44d9-8389-23de8578edac" containerName="pull"
May 20 20:55:25.371425 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.371383    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4308ca-07da-44d9-8389-23de8578edac" containerName="pull"
May 20 20:55:25.371425 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.371414    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f4308ca-07da-44d9-8389-23de8578edac" containerName="extract"
May 20 20:55:25.371532 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.371424    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4308ca-07da-44d9-8389-23de8578edac" containerName="extract"
May 20 20:55:25.371532 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.371458    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f4308ca-07da-44d9-8389-23de8578edac" containerName="util"
May 20 20:55:25.371532 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.371467    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4308ca-07da-44d9-8389-23de8578edac" containerName="util"
May 20 20:55:25.371631 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.371560    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f4308ca-07da-44d9-8389-23de8578edac" containerName="extract"
May 20 20:55:25.373949 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.373930    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:25.378966 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.378932    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:55:25.379147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.379125    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:55:25.381389 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.381370    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cqs\""
May 20 20:55:25.393004 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.392980    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"]
May 20 20:55:25.449227 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.449193    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrqd7\" (UniqueName: \"kubernetes.io/projected/c0038a9b-f034-49c8-ab88-ce944d309663-kube-api-access-qrqd7\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:25.449380 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.449245    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:25.449380 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.449268    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:25.550400 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.550351    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrqd7\" (UniqueName: \"kubernetes.io/projected/c0038a9b-f034-49c8-ab88-ce944d309663-kube-api-access-qrqd7\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:25.550629 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.550424    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:25.550629 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.550476    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:25.550835 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.550815    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:25.550880 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.550860    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:25.574490 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.574459    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrqd7\" (UniqueName: \"kubernetes.io/projected/c0038a9b-f034-49c8-ab88-ce944d309663-kube-api-access-qrqd7\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:25.684793 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.684761    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:25.826307 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:25.826274    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"]
May 20 20:55:25.827966 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:55:25.827941    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0038a9b_f034_49c8_ab88_ce944d309663.slice/crio-8b1639c90934ce7dbadef506d869355b3c90a186150a470c6a7adef77a4eba05 WatchSource:0}: Error finding container 8b1639c90934ce7dbadef506d869355b3c90a186150a470c6a7adef77a4eba05: Status 404 returned error can't find the container with id 8b1639c90934ce7dbadef506d869355b3c90a186150a470c6a7adef77a4eba05
May 20 20:55:26.069880 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:26.069786    2556 generic.go:358] "Generic (PLEG): container finished" podID="c0038a9b-f034-49c8-ab88-ce944d309663" containerID="f02775ab571565e2877af1c01c040970ff168ac9572f61b60b7b131e9ed81127" exitCode=0
May 20 20:55:26.070038 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:26.069874    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6" event={"ID":"c0038a9b-f034-49c8-ab88-ce944d309663","Type":"ContainerDied","Data":"f02775ab571565e2877af1c01c040970ff168ac9572f61b60b7b131e9ed81127"}
May 20 20:55:26.070038 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:26.069918    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6" event={"ID":"c0038a9b-f034-49c8-ab88-ce944d309663","Type":"ContainerStarted","Data":"8b1639c90934ce7dbadef506d869355b3c90a186150a470c6a7adef77a4eba05"}
May 20 20:55:30.085829 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:30.085792    2556 generic.go:358] "Generic (PLEG): container finished" podID="c0038a9b-f034-49c8-ab88-ce944d309663" containerID="0ddabe933a8253168b28ca8f30f306a7d56e60db88fc47e6f71ea9d64aaefa50" exitCode=0
May 20 20:55:30.086235 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:30.085864    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6" event={"ID":"c0038a9b-f034-49c8-ab88-ce944d309663","Type":"ContainerDied","Data":"0ddabe933a8253168b28ca8f30f306a7d56e60db88fc47e6f71ea9d64aaefa50"}
May 20 20:55:31.090649 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:31.090617    2556 generic.go:358] "Generic (PLEG): container finished" podID="c0038a9b-f034-49c8-ab88-ce944d309663" containerID="d8c5f27b147e72f6afb91f2bd088685d3431b67795104a37d571609f693c3f0a" exitCode=0
May 20 20:55:31.091032 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:31.090664    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6" event={"ID":"c0038a9b-f034-49c8-ab88-ce944d309663","Type":"ContainerDied","Data":"d8c5f27b147e72f6afb91f2bd088685d3431b67795104a37d571609f693c3f0a"}
May 20 20:55:32.220635 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:32.220608    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:32.310951 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:32.310921    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-util\") pod \"c0038a9b-f034-49c8-ab88-ce944d309663\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") "
May 20 20:55:32.311111 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:32.310978    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrqd7\" (UniqueName: \"kubernetes.io/projected/c0038a9b-f034-49c8-ab88-ce944d309663-kube-api-access-qrqd7\") pod \"c0038a9b-f034-49c8-ab88-ce944d309663\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") "
May 20 20:55:32.311111 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:32.311033    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-bundle\") pod \"c0038a9b-f034-49c8-ab88-ce944d309663\" (UID: \"c0038a9b-f034-49c8-ab88-ce944d309663\") "
May 20 20:55:32.311983 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:32.311956    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-bundle" (OuterVolumeSpecName: "bundle") pod "c0038a9b-f034-49c8-ab88-ce944d309663" (UID: "c0038a9b-f034-49c8-ab88-ce944d309663"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:55:32.313009 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:32.312984    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0038a9b-f034-49c8-ab88-ce944d309663-kube-api-access-qrqd7" (OuterVolumeSpecName: "kube-api-access-qrqd7") pod "c0038a9b-f034-49c8-ab88-ce944d309663" (UID: "c0038a9b-f034-49c8-ab88-ce944d309663"). InnerVolumeSpecName "kube-api-access-qrqd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:55:32.316222 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:32.316196    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-util" (OuterVolumeSpecName: "util") pod "c0038a9b-f034-49c8-ab88-ce944d309663" (UID: "c0038a9b-f034-49c8-ab88-ce944d309663"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:55:32.412709 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:32.412659    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrqd7\" (UniqueName: \"kubernetes.io/projected/c0038a9b-f034-49c8-ab88-ce944d309663-kube-api-access-qrqd7\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:55:32.412709 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:32.412703    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:55:32.412709 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:32.412713    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0038a9b-f034-49c8-ab88-ce944d309663-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:55:33.101183 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:33.101156    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6"
May 20 20:55:33.101183 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:33.101164    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835pmrf6" event={"ID":"c0038a9b-f034-49c8-ab88-ce944d309663","Type":"ContainerDied","Data":"8b1639c90934ce7dbadef506d869355b3c90a186150a470c6a7adef77a4eba05"}
May 20 20:55:33.101509 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:33.101209    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b1639c90934ce7dbadef506d869355b3c90a186150a470c6a7adef77a4eba05"
May 20 20:55:39.583179 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.583132    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"]
May 20 20:55:39.583608 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.583484    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0038a9b-f034-49c8-ab88-ce944d309663" containerName="extract"
May 20 20:55:39.583608 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.583496    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0038a9b-f034-49c8-ab88-ce944d309663" containerName="extract"
May 20 20:55:39.583608 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.583509    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0038a9b-f034-49c8-ab88-ce944d309663" containerName="util"
May 20 20:55:39.583608 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.583514    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0038a9b-f034-49c8-ab88-ce944d309663" containerName="util"
May 20 20:55:39.583608 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.583536    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0038a9b-f034-49c8-ab88-ce944d309663" containerName="pull"
May 20 20:55:39.583608 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.583542    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0038a9b-f034-49c8-ab88-ce944d309663" containerName="pull"
May 20 20:55:39.583608 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.583591    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0038a9b-f034-49c8-ab88-ce944d309663" containerName="extract"
May 20 20:55:39.586964 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.586941    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:39.592034 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.591997    2556 status_manager.go:895] "Failed to get status for pod" podUID="4ad6d88d-4705-4a05-af23-dc87cf4b4f24" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68" err="pods \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68\" is forbidden: User \"system:node:ip-10-0-142-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-142-248.ec2.internal' and this object"
May 20 20:55:39.592163 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.592034    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:55:39.592163 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.592102    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cqs\""
May 20 20:55:39.592330 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.592304    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:55:39.612826 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.612803    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"]
May 20 20:55:39.676551 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.676522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:39.676716 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.676571    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scptj\" (UniqueName: \"kubernetes.io/projected/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-kube-api-access-scptj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:39.676716 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.676673    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:39.777785 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.777743    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:39.777980 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.777946    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:39.778050 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.778031    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scptj\" (UniqueName: \"kubernetes.io/projected/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-kube-api-access-scptj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:39.778389 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.778349    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:39.778554 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.778521    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:39.789583 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.789558    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scptj\" (UniqueName: \"kubernetes.io/projected/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-kube-api-access-scptj\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:39.898830 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:39.898791    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:40.060598 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:40.060572    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"]
May 20 20:55:40.126251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:40.126226    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68" event={"ID":"4ad6d88d-4705-4a05-af23-dc87cf4b4f24","Type":"ContainerStarted","Data":"72c0c4ac79e512e6e75386cf7d8898dd56ed921bb6520ed8b4c89c7688f8b7f4"}
May 20 20:55:40.126420 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:40.126261    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68" event={"ID":"4ad6d88d-4705-4a05-af23-dc87cf4b4f24","Type":"ContainerStarted","Data":"6070ffb55e4744548574ee9fd04daa6aee8c721f40fb8ceb1636f5f5b1633279"}
May 20 20:55:41.130709 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:41.130623    2556 generic.go:358] "Generic (PLEG): container finished" podID="4ad6d88d-4705-4a05-af23-dc87cf4b4f24" containerID="72c0c4ac79e512e6e75386cf7d8898dd56ed921bb6520ed8b4c89c7688f8b7f4" exitCode=0
May 20 20:55:41.131147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:41.130713    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68" event={"ID":"4ad6d88d-4705-4a05-af23-dc87cf4b4f24","Type":"ContainerDied","Data":"72c0c4ac79e512e6e75386cf7d8898dd56ed921bb6520ed8b4c89c7688f8b7f4"}
May 20 20:55:43.139614 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:43.139580    2556 generic.go:358] "Generic (PLEG): container finished" podID="4ad6d88d-4705-4a05-af23-dc87cf4b4f24" containerID="e3fefc8e83890afae3e30b3f6949acbe759975c34fdd9961d2b2447c5b4ba269" exitCode=0
May 20 20:55:43.139992 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:43.139645    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68" event={"ID":"4ad6d88d-4705-4a05-af23-dc87cf4b4f24","Type":"ContainerDied","Data":"e3fefc8e83890afae3e30b3f6949acbe759975c34fdd9961d2b2447c5b4ba269"}
May 20 20:55:44.145488 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:44.145447    2556 generic.go:358] "Generic (PLEG): container finished" podID="4ad6d88d-4705-4a05-af23-dc87cf4b4f24" containerID="ef7d5b3491eeffccc4361df057233bbcf1572b3f3bfc40e07cb1e4cbe94f679f" exitCode=0
May 20 20:55:44.145874 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:44.145534    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68" event={"ID":"4ad6d88d-4705-4a05-af23-dc87cf4b4f24","Type":"ContainerDied","Data":"ef7d5b3491eeffccc4361df057233bbcf1572b3f3bfc40e07cb1e4cbe94f679f"}
May 20 20:55:45.277528 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:45.277505    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:45.426311 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:45.426237    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-bundle\") pod \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") "
May 20 20:55:45.426477 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:45.426336    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scptj\" (UniqueName: \"kubernetes.io/projected/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-kube-api-access-scptj\") pod \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") "
May 20 20:55:45.426477 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:45.426352    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-util\") pod \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\" (UID: \"4ad6d88d-4705-4a05-af23-dc87cf4b4f24\") "
May 20 20:55:45.427132 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:45.427105    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-bundle" (OuterVolumeSpecName: "bundle") pod "4ad6d88d-4705-4a05-af23-dc87cf4b4f24" (UID: "4ad6d88d-4705-4a05-af23-dc87cf4b4f24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:55:45.428411 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:45.428386    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-kube-api-access-scptj" (OuterVolumeSpecName: "kube-api-access-scptj") pod "4ad6d88d-4705-4a05-af23-dc87cf4b4f24" (UID: "4ad6d88d-4705-4a05-af23-dc87cf4b4f24"). InnerVolumeSpecName "kube-api-access-scptj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:55:45.432675 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:45.432649    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-util" (OuterVolumeSpecName: "util") pod "4ad6d88d-4705-4a05-af23-dc87cf4b4f24" (UID: "4ad6d88d-4705-4a05-af23-dc87cf4b4f24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:55:45.527285 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:45.527255    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:55:45.527285 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:45.527280    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scptj\" (UniqueName: \"kubernetes.io/projected/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-kube-api-access-scptj\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:55:45.527285 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:45.527290    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ad6d88d-4705-4a05-af23-dc87cf4b4f24-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:55:46.153958 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:46.153932    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68"
May 20 20:55:46.154108 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:46.153950    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762apff68" event={"ID":"4ad6d88d-4705-4a05-af23-dc87cf4b4f24","Type":"ContainerDied","Data":"6070ffb55e4744548574ee9fd04daa6aee8c721f40fb8ceb1636f5f5b1633279"}
May 20 20:55:46.154108 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:55:46.153985    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6070ffb55e4744548574ee9fd04daa6aee8c721f40fb8ceb1636f5f5b1633279"
May 20 20:56:32.267568 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.267532    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"]
May 20 20:56:32.268056 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.268040    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad6d88d-4705-4a05-af23-dc87cf4b4f24" containerName="util"
May 20 20:56:32.268099 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.268059    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad6d88d-4705-4a05-af23-dc87cf4b4f24" containerName="util"
May 20 20:56:32.268099 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.268095    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad6d88d-4705-4a05-af23-dc87cf4b4f24" containerName="extract"
May 20 20:56:32.268162 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.268106    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad6d88d-4705-4a05-af23-dc87cf4b4f24" containerName="extract"
May 20 20:56:32.268162 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.268126    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad6d88d-4705-4a05-af23-dc87cf4b4f24" containerName="pull"
May 20 20:56:32.268162 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.268135    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad6d88d-4705-4a05-af23-dc87cf4b4f24" containerName="pull"
May 20 20:56:32.268253 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.268207    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ad6d88d-4705-4a05-af23-dc87cf4b4f24" containerName="extract"
May 20 20:56:32.273206 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.273186    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.276950 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.276926    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b45z5\""
May 20 20:56:32.277215 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.277196    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 20 20:56:32.283236 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.283213    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"]
May 20 20:56:32.415741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.415700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.415909 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.415750    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.415909 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.415808    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.415909 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.415839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.415909 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.415866    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.416047 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.415961    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zmw6\" (UniqueName: \"kubernetes.io/projected/c763f752-5529-4473-8c0d-c8834f1a14ff-kube-api-access-2zmw6\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.416047 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.416004    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c763f752-5529-4473-8c0d-c8834f1a14ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.416047 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.416035    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.416142 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.416101    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.516995 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.516953    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.517189 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517017    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.517189 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517088    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zmw6\" (UniqueName: \"kubernetes.io/projected/c763f752-5529-4473-8c0d-c8834f1a14ff-kube-api-access-2zmw6\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.517189 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517115    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c763f752-5529-4473-8c0d-c8834f1a14ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.517189 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517150    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.517189 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517173    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.517498 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517256    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.517498 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517281    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.517498 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517306    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.517498 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517366    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.518046 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517882    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.518046 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517941    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.518046 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517979    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.518046 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.517981    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c763f752-5529-4473-8c0d-c8834f1a14ff-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.519657 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.519625    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.520102 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.520083    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.527989 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.527969    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c763f752-5529-4473-8c0d-c8834f1a14ff-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.528501 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.528482    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zmw6\" (UniqueName: \"kubernetes.io/projected/c763f752-5529-4473-8c0d-c8834f1a14ff-kube-api-access-2zmw6\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj\" (UID: \"c763f752-5529-4473-8c0d-c8834f1a14ff\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.586740 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.586648    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:32.738748 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:32.738701    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"]
May 20 20:56:32.741821 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:56:32.741789    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc763f752_5529_4473_8c0d_c8834f1a14ff.slice/crio-9102653e145c4d96f4d172a4612810c25ea2aaa6e91a3eca452174b10f6ef151 WatchSource:0}: Error finding container 9102653e145c4d96f4d172a4612810c25ea2aaa6e91a3eca452174b10f6ef151: Status 404 returned error can't find the container with id 9102653e145c4d96f4d172a4612810c25ea2aaa6e91a3eca452174b10f6ef151
May 20 20:56:33.327212 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:33.327175    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj" event={"ID":"c763f752-5529-4473-8c0d-c8834f1a14ff","Type":"ContainerStarted","Data":"9102653e145c4d96f4d172a4612810c25ea2aaa6e91a3eca452174b10f6ef151"}
May 20 20:56:35.459829 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:35.459788    2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 20 20:56:35.460130 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:35.459866    2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 20 20:56:35.460130 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:35.459896    2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 20 20:56:36.341189 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:36.341151    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj" event={"ID":"c763f752-5529-4473-8c0d-c8834f1a14ff","Type":"ContainerStarted","Data":"b61c2c5ccfae7761b661ceca537d762d816dfca3dc2fb3bc7d2aec8287fa53cc"}
May 20 20:56:36.367239 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:36.367183    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj" podStartSLOduration=1.651553203 podStartE2EDuration="4.367168196s" podCreationTimestamp="2026-05-20 20:56:32 +0000 UTC" firstStartedPulling="2026-05-20 20:56:32.743943688 +0000 UTC m=+465.673540405" lastFinishedPulling="2026-05-20 20:56:35.459558678 +0000 UTC m=+468.389155398" observedRunningTime="2026-05-20 20:56:36.36455568 +0000 UTC m=+469.294152430" watchObservedRunningTime="2026-05-20 20:56:36.367168196 +0000 UTC m=+469.296764935"
May 20 20:56:36.587199 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:36.587165    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:36.591785 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:36.591724    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:37.344762 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:37.344729    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:37.345649 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:37.345632    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj"
May 20 20:56:37.932075 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:37.932038    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"]
May 20 20:56:37.935742 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:37.935722    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:37.938713 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:37.938692    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 20 20:56:37.939241 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:37.939223    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 20 20:56:37.939312 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:37.939226    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-25hd5\""
May 20 20:56:37.945648 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:37.945627    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"]
May 20 20:56:38.068867 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.068828    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:38.068867 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.068867    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsjns\" (UniqueName: \"kubernetes.io/projected/9c431124-6627-43bd-a145-97d52389a4ad-kube-api-access-nsjns\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:38.069121 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.069020    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:38.170179 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.170139    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:38.170179 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.170180    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nsjns\" (UniqueName: \"kubernetes.io/projected/9c431124-6627-43bd-a145-97d52389a4ad-kube-api-access-nsjns\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:38.170463 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.170240    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:38.170654 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.170630    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:38.170718 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.170656    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:38.182304 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.182252    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsjns\" (UniqueName: \"kubernetes.io/projected/9c431124-6627-43bd-a145-97d52389a4ad-kube-api-access-nsjns\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:38.245491 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.245454    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:38.375686 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.375662    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"]
May 20 20:56:38.377469 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:56:38.377425    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c431124_6627_43bd_a145_97d52389a4ad.slice/crio-72246586cf353cfa1ed87beff302c3f4607d89b90a2150a8dcbb20bafa1ed450 WatchSource:0}: Error finding container 72246586cf353cfa1ed87beff302c3f4607d89b90a2150a8dcbb20bafa1ed450: Status 404 returned error can't find the container with id 72246586cf353cfa1ed87beff302c3f4607d89b90a2150a8dcbb20bafa1ed450
May 20 20:56:38.531185 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.531154    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"]
May 20 20:56:38.534715 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.534696    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:38.545382 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.545358    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"]
May 20 20:56:38.675245 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.675217    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:38.675387 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.675250    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:38.675387 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.675290    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2srwg\" (UniqueName: \"kubernetes.io/projected/28c96318-bb41-4972-9367-d7ce621effe0-kube-api-access-2srwg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:38.775979 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.775901    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2srwg\" (UniqueName: \"kubernetes.io/projected/28c96318-bb41-4972-9367-d7ce621effe0-kube-api-access-2srwg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:38.776119 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.776010    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:38.776119 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.776031    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:38.776425 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.776405    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:38.776484 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.776421    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:38.786931 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.786908    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2srwg\" (UniqueName: \"kubernetes.io/projected/28c96318-bb41-4972-9367-d7ce621effe0-kube-api-access-2srwg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:38.855809 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.855786    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:38.984349 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:38.984321    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"]
May 20 20:56:38.985627 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:56:38.985595    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28c96318_bb41_4972_9367_d7ce621effe0.slice/crio-3f61edb96157d8351223d3d526b5655106b6c7672e6a76921b1ea272a5047fb3 WatchSource:0}: Error finding container 3f61edb96157d8351223d3d526b5655106b6c7672e6a76921b1ea272a5047fb3: Status 404 returned error can't find the container with id 3f61edb96157d8351223d3d526b5655106b6c7672e6a76921b1ea272a5047fb3
May 20 20:56:39.134187 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.134156    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"]
May 20 20:56:39.137734 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.137715    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:39.146554 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.146532    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"]
May 20 20:56:39.280936 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.280900    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:39.280936 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.280941    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gknzz\" (UniqueName: \"kubernetes.io/projected/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-kube-api-access-gknzz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:39.281133 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.281044    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:39.360210 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.360121    2556 generic.go:358] "Generic (PLEG): container finished" podID="9c431124-6627-43bd-a145-97d52389a4ad" containerID="6072ad1240c5c6556a8d52871790f36511cc6f17d5b0c6c7156fa2884747d52c" exitCode=0
May 20 20:56:39.360375 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.360209    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg" event={"ID":"9c431124-6627-43bd-a145-97d52389a4ad","Type":"ContainerDied","Data":"6072ad1240c5c6556a8d52871790f36511cc6f17d5b0c6c7156fa2884747d52c"}
May 20 20:56:39.360375 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.360254    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg" event={"ID":"9c431124-6627-43bd-a145-97d52389a4ad","Type":"ContainerStarted","Data":"72246586cf353cfa1ed87beff302c3f4607d89b90a2150a8dcbb20bafa1ed450"}
May 20 20:56:39.361634 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.361613    2556 generic.go:358] "Generic (PLEG): container finished" podID="28c96318-bb41-4972-9367-d7ce621effe0" containerID="e0430f437fed1152a2ff09fa78c2f1665a13bae2d918c63e31574e59105ddb97" exitCode=0
May 20 20:56:39.361717 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.361697    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2" event={"ID":"28c96318-bb41-4972-9367-d7ce621effe0","Type":"ContainerDied","Data":"e0430f437fed1152a2ff09fa78c2f1665a13bae2d918c63e31574e59105ddb97"}
May 20 20:56:39.361756 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.361728    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2" event={"ID":"28c96318-bb41-4972-9367-d7ce621effe0","Type":"ContainerStarted","Data":"3f61edb96157d8351223d3d526b5655106b6c7672e6a76921b1ea272a5047fb3"}
May 20 20:56:39.382199 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.382172    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:39.382357 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.382221    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gknzz\" (UniqueName: \"kubernetes.io/projected/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-kube-api-access-gknzz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:39.382357 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.382300    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:39.382710 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.382687    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:39.382783 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.382749    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:39.394693 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.394671    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gknzz\" (UniqueName: \"kubernetes.io/projected/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-kube-api-access-gknzz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:39.447388 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.447362    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:39.576351 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.576322    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"]
May 20 20:56:39.577184 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:56:39.577161    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc10bf7e_37f4_4393_ad3d_74ea9a5c8bfc.slice/crio-6ad4f5a29ad0953ac6997cc8989624b5113bb0e07af59c4285d66d80943e7145 WatchSource:0}: Error finding container 6ad4f5a29ad0953ac6997cc8989624b5113bb0e07af59c4285d66d80943e7145: Status 404 returned error can't find the container with id 6ad4f5a29ad0953ac6997cc8989624b5113bb0e07af59c4285d66d80943e7145
May 20 20:56:39.747609 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.747573    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"]
May 20 20:56:39.751443 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.751416    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:39.761420 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.761393    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"]
May 20 20:56:39.887196 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.887120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:39.887196 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.887189    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6dnm\" (UniqueName: \"kubernetes.io/projected/e2d024ad-7352-4302-8049-dab5660b72ff-kube-api-access-b6dnm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:39.887356 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.887242    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:39.988276 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.988243    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6dnm\" (UniqueName: \"kubernetes.io/projected/e2d024ad-7352-4302-8049-dab5660b72ff-kube-api-access-b6dnm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:39.988685 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.988335    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:39.988685 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.988408    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:39.988757 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.988734    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:39.988757 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:39.988749    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:40.000105 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:40.000080    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6dnm\" (UniqueName: \"kubernetes.io/projected/e2d024ad-7352-4302-8049-dab5660b72ff-kube-api-access-b6dnm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:40.061214 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:40.061182    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:40.295810 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:40.295786    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"]
May 20 20:56:40.330427 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:56:40.330394    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d024ad_7352_4302_8049_dab5660b72ff.slice/crio-9de85ba4b3cb6be3add699df853dca85c65e62e6862aca51f99975d2f7d4b6ec WatchSource:0}: Error finding container 9de85ba4b3cb6be3add699df853dca85c65e62e6862aca51f99975d2f7d4b6ec: Status 404 returned error can't find the container with id 9de85ba4b3cb6be3add699df853dca85c65e62e6862aca51f99975d2f7d4b6ec
May 20 20:56:40.367179 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:40.367140    2556 generic.go:358] "Generic (PLEG): container finished" podID="28c96318-bb41-4972-9367-d7ce621effe0" containerID="d1d7ff89844da43e82a675974204c0ec55f0563f241bcc892b49ac78df756981" exitCode=0
May 20 20:56:40.367281 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:40.367220    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2" event={"ID":"28c96318-bb41-4972-9367-d7ce621effe0","Type":"ContainerDied","Data":"d1d7ff89844da43e82a675974204c0ec55f0563f241bcc892b49ac78df756981"}
May 20 20:56:40.368725 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:40.368703    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq" event={"ID":"e2d024ad-7352-4302-8049-dab5660b72ff","Type":"ContainerStarted","Data":"9de85ba4b3cb6be3add699df853dca85c65e62e6862aca51f99975d2f7d4b6ec"}
May 20 20:56:40.370411 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:40.370385    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg" event={"ID":"9c431124-6627-43bd-a145-97d52389a4ad","Type":"ContainerStarted","Data":"ace8eb9d4f9caa5a1bd26eab9e839a92c41bd26f4d0802cf19161a5abe9d51f2"}
May 20 20:56:40.371696 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:40.371674    2556 generic.go:358] "Generic (PLEG): container finished" podID="cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" containerID="d5f47cbe9aaf19e6e0e51076a9e335f8db5c2d57386e9009ac74c45a47c0d44f" exitCode=0
May 20 20:56:40.371791 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:40.371757    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx" event={"ID":"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc","Type":"ContainerDied","Data":"d5f47cbe9aaf19e6e0e51076a9e335f8db5c2d57386e9009ac74c45a47c0d44f"}
May 20 20:56:40.371839 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:40.371789    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx" event={"ID":"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc","Type":"ContainerStarted","Data":"6ad4f5a29ad0953ac6997cc8989624b5113bb0e07af59c4285d66d80943e7145"}
May 20 20:56:41.378019 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:41.377930    2556 generic.go:358] "Generic (PLEG): container finished" podID="28c96318-bb41-4972-9367-d7ce621effe0" containerID="cd1b63f3348fc9ed3996cadc6258e35cb83a6436c886b6dd128be822072c182a" exitCode=0
May 20 20:56:41.378019 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:41.377998    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2" event={"ID":"28c96318-bb41-4972-9367-d7ce621effe0","Type":"ContainerDied","Data":"cd1b63f3348fc9ed3996cadc6258e35cb83a6436c886b6dd128be822072c182a"}
May 20 20:56:41.379227 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:41.379203    2556 generic.go:358] "Generic (PLEG): container finished" podID="e2d024ad-7352-4302-8049-dab5660b72ff" containerID="ca903e689865af027766d5ea7f5b054d36877e549fe97175c65e97c12d49b1d4" exitCode=0
May 20 20:56:41.379328 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:41.379282    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq" event={"ID":"e2d024ad-7352-4302-8049-dab5660b72ff","Type":"ContainerDied","Data":"ca903e689865af027766d5ea7f5b054d36877e549fe97175c65e97c12d49b1d4"}
May 20 20:56:41.380940 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:41.380919    2556 generic.go:358] "Generic (PLEG): container finished" podID="9c431124-6627-43bd-a145-97d52389a4ad" containerID="ace8eb9d4f9caa5a1bd26eab9e839a92c41bd26f4d0802cf19161a5abe9d51f2" exitCode=0
May 20 20:56:41.381058 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:41.381007    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg" event={"ID":"9c431124-6627-43bd-a145-97d52389a4ad","Type":"ContainerDied","Data":"ace8eb9d4f9caa5a1bd26eab9e839a92c41bd26f4d0802cf19161a5abe9d51f2"}
May 20 20:56:41.382694 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:41.382631    2556 generic.go:358] "Generic (PLEG): container finished" podID="cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" containerID="5f356efe05f284a62caa84f82eef1c507989a74593122253636097d6b4c26c34" exitCode=0
May 20 20:56:41.382694 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:41.382671    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx" event={"ID":"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc","Type":"ContainerDied","Data":"5f356efe05f284a62caa84f82eef1c507989a74593122253636097d6b4c26c34"}
May 20 20:56:42.387621 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.387583    2556 generic.go:358] "Generic (PLEG): container finished" podID="e2d024ad-7352-4302-8049-dab5660b72ff" containerID="dece7c46f8587f97edeee8f69c836ac7e0640bdcab32a8ff68ada91c81bbf7de" exitCode=0
May 20 20:56:42.388092 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.387630    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq" event={"ID":"e2d024ad-7352-4302-8049-dab5660b72ff","Type":"ContainerDied","Data":"dece7c46f8587f97edeee8f69c836ac7e0640bdcab32a8ff68ada91c81bbf7de"}
May 20 20:56:42.389662 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.389639    2556 generic.go:358] "Generic (PLEG): container finished" podID="9c431124-6627-43bd-a145-97d52389a4ad" containerID="e507787e6d22b8e1f75b6129b36968522ec4a073c320453324f76eba08913e13" exitCode=0
May 20 20:56:42.389768 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.389728    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg" event={"ID":"9c431124-6627-43bd-a145-97d52389a4ad","Type":"ContainerDied","Data":"e507787e6d22b8e1f75b6129b36968522ec4a073c320453324f76eba08913e13"}
May 20 20:56:42.391631 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.391601    2556 generic.go:358] "Generic (PLEG): container finished" podID="cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" containerID="6a6e3676c902bf59a7f687b8e19a292130982a6f0cd181a149855e31a5d23d52" exitCode=0
May 20 20:56:42.391728 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.391684    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx" event={"ID":"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc","Type":"ContainerDied","Data":"6a6e3676c902bf59a7f687b8e19a292130982a6f0cd181a149855e31a5d23d52"}
May 20 20:56:42.527606 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.527582    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:42.715501 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.715394    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-util\") pod \"28c96318-bb41-4972-9367-d7ce621effe0\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") "
May 20 20:56:42.715501 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.715461    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2srwg\" (UniqueName: \"kubernetes.io/projected/28c96318-bb41-4972-9367-d7ce621effe0-kube-api-access-2srwg\") pod \"28c96318-bb41-4972-9367-d7ce621effe0\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") "
May 20 20:56:42.715501 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.715498    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-bundle\") pod \"28c96318-bb41-4972-9367-d7ce621effe0\" (UID: \"28c96318-bb41-4972-9367-d7ce621effe0\") "
May 20 20:56:42.716159 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.716130    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-bundle" (OuterVolumeSpecName: "bundle") pod "28c96318-bb41-4972-9367-d7ce621effe0" (UID: "28c96318-bb41-4972-9367-d7ce621effe0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:56:42.717725 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.717707    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28c96318-bb41-4972-9367-d7ce621effe0-kube-api-access-2srwg" (OuterVolumeSpecName: "kube-api-access-2srwg") pod "28c96318-bb41-4972-9367-d7ce621effe0" (UID: "28c96318-bb41-4972-9367-d7ce621effe0"). InnerVolumeSpecName "kube-api-access-2srwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:56:42.720462 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.720425    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-util" (OuterVolumeSpecName: "util") pod "28c96318-bb41-4972-9367-d7ce621effe0" (UID: "28c96318-bb41-4972-9367-d7ce621effe0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:56:42.816716 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.816687    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:42.816716 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.816710    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2srwg\" (UniqueName: \"kubernetes.io/projected/28c96318-bb41-4972-9367-d7ce621effe0-kube-api-access-2srwg\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:42.816716 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:42.816721    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28c96318-bb41-4972-9367-d7ce621effe0-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:43.397481 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.397427    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2" event={"ID":"28c96318-bb41-4972-9367-d7ce621effe0","Type":"ContainerDied","Data":"3f61edb96157d8351223d3d526b5655106b6c7672e6a76921b1ea272a5047fb3"}
May 20 20:56:43.397481 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.397468    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2"
May 20 20:56:43.397481 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.397483    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f61edb96157d8351223d3d526b5655106b6c7672e6a76921b1ea272a5047fb3"
May 20 20:56:43.399414 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.399386    2556 generic.go:358] "Generic (PLEG): container finished" podID="e2d024ad-7352-4302-8049-dab5660b72ff" containerID="b867b1cc158c0e80d13a7a4f52b4d3a5175caf835fdf426e0b76060287ae348d" exitCode=0
May 20 20:56:43.399551 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.399476    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq" event={"ID":"e2d024ad-7352-4302-8049-dab5660b72ff","Type":"ContainerDied","Data":"b867b1cc158c0e80d13a7a4f52b4d3a5175caf835fdf426e0b76060287ae348d"}
May 20 20:56:43.524661 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.524639    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:43.553874 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.553850    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:43.624398 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.624367    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-util\") pod \"9c431124-6627-43bd-a145-97d52389a4ad\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") "
May 20 20:56:43.624583 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.624404    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsjns\" (UniqueName: \"kubernetes.io/projected/9c431124-6627-43bd-a145-97d52389a4ad-kube-api-access-nsjns\") pod \"9c431124-6627-43bd-a145-97d52389a4ad\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") "
May 20 20:56:43.624583 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.624479    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-util\") pod \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") "
May 20 20:56:43.624583 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.624523    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-bundle\") pod \"9c431124-6627-43bd-a145-97d52389a4ad\" (UID: \"9c431124-6627-43bd-a145-97d52389a4ad\") "
May 20 20:56:43.624583 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.624542    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-bundle\") pod \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") "
May 20 20:56:43.624583 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.624558    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gknzz\" (UniqueName: \"kubernetes.io/projected/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-kube-api-access-gknzz\") pod \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\" (UID: \"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc\") "
May 20 20:56:43.625045 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.625016    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-bundle" (OuterVolumeSpecName: "bundle") pod "9c431124-6627-43bd-a145-97d52389a4ad" (UID: "9c431124-6627-43bd-a145-97d52389a4ad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:56:43.625162 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.625100    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-bundle" (OuterVolumeSpecName: "bundle") pod "cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" (UID: "cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:56:43.626625 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.626599    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c431124-6627-43bd-a145-97d52389a4ad-kube-api-access-nsjns" (OuterVolumeSpecName: "kube-api-access-nsjns") pod "9c431124-6627-43bd-a145-97d52389a4ad" (UID: "9c431124-6627-43bd-a145-97d52389a4ad"). InnerVolumeSpecName "kube-api-access-nsjns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:56:43.627098 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.627078    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-kube-api-access-gknzz" (OuterVolumeSpecName: "kube-api-access-gknzz") pod "cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" (UID: "cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc"). InnerVolumeSpecName "kube-api-access-gknzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:56:43.630244 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.630223    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-util" (OuterVolumeSpecName: "util") pod "9c431124-6627-43bd-a145-97d52389a4ad" (UID: "9c431124-6627-43bd-a145-97d52389a4ad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:56:43.630813 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.630793    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-util" (OuterVolumeSpecName: "util") pod "cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" (UID: "cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:56:43.725577 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.725516    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:43.725577 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.725542    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsjns\" (UniqueName: \"kubernetes.io/projected/9c431124-6627-43bd-a145-97d52389a4ad-kube-api-access-nsjns\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:43.725577 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.725551    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:43.725577 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.725560    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c431124-6627-43bd-a145-97d52389a4ad-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:43.725577 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.725569    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:43.725577 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:43.725580    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gknzz\" (UniqueName: \"kubernetes.io/projected/cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc-kube-api-access-gknzz\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:44.404741 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.404710    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg"
May 20 20:56:44.405201 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.404714    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg" event={"ID":"9c431124-6627-43bd-a145-97d52389a4ad","Type":"ContainerDied","Data":"72246586cf353cfa1ed87beff302c3f4607d89b90a2150a8dcbb20bafa1ed450"}
May 20 20:56:44.405201 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.404832    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72246586cf353cfa1ed87beff302c3f4607d89b90a2150a8dcbb20bafa1ed450"
May 20 20:56:44.406403 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.406383    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx"
May 20 20:56:44.406533 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.406416    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx" event={"ID":"cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc","Type":"ContainerDied","Data":"6ad4f5a29ad0953ac6997cc8989624b5113bb0e07af59c4285d66d80943e7145"}
May 20 20:56:44.406533 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.406459    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ad4f5a29ad0953ac6997cc8989624b5113bb0e07af59c4285d66d80943e7145"
May 20 20:56:44.533474 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.533428    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:44.631602 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.631573    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-util\") pod \"e2d024ad-7352-4302-8049-dab5660b72ff\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") "
May 20 20:56:44.631747 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.631608    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6dnm\" (UniqueName: \"kubernetes.io/projected/e2d024ad-7352-4302-8049-dab5660b72ff-kube-api-access-b6dnm\") pod \"e2d024ad-7352-4302-8049-dab5660b72ff\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") "
May 20 20:56:44.631747 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.631655    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-bundle\") pod \"e2d024ad-7352-4302-8049-dab5660b72ff\" (UID: \"e2d024ad-7352-4302-8049-dab5660b72ff\") "
May 20 20:56:44.632147 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.632125    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-bundle" (OuterVolumeSpecName: "bundle") pod "e2d024ad-7352-4302-8049-dab5660b72ff" (UID: "e2d024ad-7352-4302-8049-dab5660b72ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:56:44.633667 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.633644    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d024ad-7352-4302-8049-dab5660b72ff-kube-api-access-b6dnm" (OuterVolumeSpecName: "kube-api-access-b6dnm") pod "e2d024ad-7352-4302-8049-dab5660b72ff" (UID: "e2d024ad-7352-4302-8049-dab5660b72ff"). InnerVolumeSpecName "kube-api-access-b6dnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:56:44.636697 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.636666    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-util" (OuterVolumeSpecName: "util") pod "e2d024ad-7352-4302-8049-dab5660b72ff" (UID: "e2d024ad-7352-4302-8049-dab5660b72ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:56:44.732253 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.732228    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:44.732253 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.732252    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6dnm\" (UniqueName: \"kubernetes.io/projected/e2d024ad-7352-4302-8049-dab5660b72ff-kube-api-access-b6dnm\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:44.732488 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:44.732261    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d024ad-7352-4302-8049-dab5660b72ff-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:56:45.411558 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:45.411532    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq"
May 20 20:56:45.411942 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:45.411528    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq" event={"ID":"e2d024ad-7352-4302-8049-dab5660b72ff","Type":"ContainerDied","Data":"9de85ba4b3cb6be3add699df853dca85c65e62e6862aca51f99975d2f7d4b6ec"}
May 20 20:56:45.411942 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:45.411645    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9de85ba4b3cb6be3add699df853dca85c65e62e6862aca51f99975d2f7d4b6ec"
May 20 20:56:54.387373 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387336    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"]
May 20 20:56:54.387752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387699    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c96318-bb41-4972-9367-d7ce621effe0" containerName="pull"
May 20 20:56:54.387752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387710    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c96318-bb41-4972-9367-d7ce621effe0" containerName="pull"
May 20 20:56:54.387752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387718    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d024ad-7352-4302-8049-dab5660b72ff" containerName="util"
May 20 20:56:54.387752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387723    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d024ad-7352-4302-8049-dab5660b72ff" containerName="util"
May 20 20:56:54.387752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387732    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" containerName="extract"
May 20 20:56:54.387752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387737    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" containerName="extract"
May 20 20:56:54.387752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387747    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c431124-6627-43bd-a145-97d52389a4ad" containerName="pull"
May 20 20:56:54.387752 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387752    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c431124-6627-43bd-a145-97d52389a4ad" containerName="pull"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387759    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d024ad-7352-4302-8049-dab5660b72ff" containerName="extract"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387763    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d024ad-7352-4302-8049-dab5660b72ff" containerName="extract"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387779    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c96318-bb41-4972-9367-d7ce621effe0" containerName="util"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387783    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c96318-bb41-4972-9367-d7ce621effe0" containerName="util"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387789    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" containerName="util"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387794    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" containerName="util"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387799    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" containerName="pull"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387804    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" containerName="pull"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387815    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c431124-6627-43bd-a145-97d52389a4ad" containerName="util"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387819    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c431124-6627-43bd-a145-97d52389a4ad" containerName="util"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387824    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d024ad-7352-4302-8049-dab5660b72ff" containerName="pull"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387828    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d024ad-7352-4302-8049-dab5660b72ff" containerName="pull"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387835    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28c96318-bb41-4972-9367-d7ce621effe0" containerName="extract"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387840    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="28c96318-bb41-4972-9367-d7ce621effe0" containerName="extract"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387846    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c431124-6627-43bd-a145-97d52389a4ad" containerName="extract"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387850    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c431124-6627-43bd-a145-97d52389a4ad" containerName="extract"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387904    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2d024ad-7352-4302-8049-dab5660b72ff" containerName="extract"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387910    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c431124-6627-43bd-a145-97d52389a4ad" containerName="extract"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387917    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="28c96318-bb41-4972-9367-d7ce621effe0" containerName="extract"
May 20 20:56:54.387988 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.387923    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc" containerName="extract"
May 20 20:56:54.392517 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.392500    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"
May 20 20:56:54.407750 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.407725    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plb4p\" (UniqueName: \"kubernetes.io/projected/06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c-kube-api-access-plb4p\") pod \"limitador-operator-controller-manager-85c4996f8c-d5jgn\" (UID: \"06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"
May 20 20:56:54.410635 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.410612    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 20 20:56:54.411342 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.411324    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 20 20:56:54.411426 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.411347    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6qqj2\""
May 20 20:56:54.411426 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.411413    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"]
May 20 20:56:54.509104 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.509067    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-plb4p\" (UniqueName: \"kubernetes.io/projected/06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c-kube-api-access-plb4p\") pod \"limitador-operator-controller-manager-85c4996f8c-d5jgn\" (UID: \"06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"
May 20 20:56:54.528828 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.528805    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plb4p\" (UniqueName: \"kubernetes.io/projected/06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c-kube-api-access-plb4p\") pod \"limitador-operator-controller-manager-85c4996f8c-d5jgn\" (UID: \"06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"
May 20 20:56:54.702208 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.702107    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"
May 20 20:56:54.859294 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:54.859265    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"]
May 20 20:56:54.860470 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:56:54.860443    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06dbf99d_9bd8_4f5f_9f8b_22da2ec50f5c.slice/crio-edf4dd4708ccc1d79cea2d019d016df0edf4ccff3d7a24bc906b5e1b1850fcdf WatchSource:0}: Error finding container edf4dd4708ccc1d79cea2d019d016df0edf4ccff3d7a24bc906b5e1b1850fcdf: Status 404 returned error can't find the container with id edf4dd4708ccc1d79cea2d019d016df0edf4ccff3d7a24bc906b5e1b1850fcdf
May 20 20:56:55.451937 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:55.451901    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn" event={"ID":"06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c","Type":"ContainerStarted","Data":"edf4dd4708ccc1d79cea2d019d016df0edf4ccff3d7a24bc906b5e1b1850fcdf"}
May 20 20:56:56.415761 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.415723    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5486cd7785-rwgsb"]
May 20 20:56:56.419631 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.419599    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.446826 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.446791    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5486cd7785-rwgsb"]
May 20 20:56:56.526691 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.526648    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/003a34fc-68b1-4e4b-b342-b352e3ff68ac-console-oauth-config\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.527133 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.526746    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/003a34fc-68b1-4e4b-b342-b352e3ff68ac-console-serving-cert\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.527133 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.526773    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-console-config\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.527133 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.526791    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-oauth-serving-cert\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.527133 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.526813    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-trusted-ca-bundle\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.527133 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.526913    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-service-ca\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.527133 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.526940    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pxcn\" (UniqueName: \"kubernetes.io/projected/003a34fc-68b1-4e4b-b342-b352e3ff68ac-kube-api-access-4pxcn\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.627401 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.627372    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/003a34fc-68b1-4e4b-b342-b352e3ff68ac-console-oauth-config\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.627523 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.627455    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/003a34fc-68b1-4e4b-b342-b352e3ff68ac-console-serving-cert\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.627523 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.627481    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-console-config\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.627523 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.627498    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-oauth-serving-cert\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.627523 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.627517    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-trusted-ca-bundle\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.627688 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.627585    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-service-ca\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.627688 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.627609    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pxcn\" (UniqueName: \"kubernetes.io/projected/003a34fc-68b1-4e4b-b342-b352e3ff68ac-kube-api-access-4pxcn\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.628304 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.628254    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-console-config\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.628663 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.628600    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-service-ca\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.628759 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.628697    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-oauth-serving-cert\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.628759 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.628702    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/003a34fc-68b1-4e4b-b342-b352e3ff68ac-trusted-ca-bundle\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.629938 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.629919    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/003a34fc-68b1-4e4b-b342-b352e3ff68ac-console-oauth-config\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.630646 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.630624    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/003a34fc-68b1-4e4b-b342-b352e3ff68ac-console-serving-cert\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.639202 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.639182    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pxcn\" (UniqueName: \"kubernetes.io/projected/003a34fc-68b1-4e4b-b342-b352e3ff68ac-kube-api-access-4pxcn\") pod \"console-5486cd7785-rwgsb\" (UID: \"003a34fc-68b1-4e4b-b342-b352e3ff68ac\") " pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.734112 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.734026    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:56:56.876771 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:56.876748    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5486cd7785-rwgsb"]
May 20 20:56:56.878337 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:56:56.878309    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003a34fc_68b1_4e4b_b342_b352e3ff68ac.slice/crio-5e97db7def0714ee7a0bbe0d05727f25fa9a7d3bb643f3a04888dfb041143167 WatchSource:0}: Error finding container 5e97db7def0714ee7a0bbe0d05727f25fa9a7d3bb643f3a04888dfb041143167: Status 404 returned error can't find the container with id 5e97db7def0714ee7a0bbe0d05727f25fa9a7d3bb643f3a04888dfb041143167
May 20 20:56:57.463372 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:57.463331    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn" event={"ID":"06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c","Type":"ContainerStarted","Data":"05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49"}
May 20 20:56:57.463597 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:57.463407    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"
May 20 20:56:57.464719 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:57.464697    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5486cd7785-rwgsb" event={"ID":"003a34fc-68b1-4e4b-b342-b352e3ff68ac","Type":"ContainerStarted","Data":"c4f6f1424207bddaeae7a5154ab727d879fed560a597513431164c393c52a56a"}
May 20 20:56:57.464719 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:57.464722    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5486cd7785-rwgsb" event={"ID":"003a34fc-68b1-4e4b-b342-b352e3ff68ac","Type":"ContainerStarted","Data":"5e97db7def0714ee7a0bbe0d05727f25fa9a7d3bb643f3a04888dfb041143167"}
May 20 20:56:57.497037 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:56:57.496992    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn" podStartSLOduration=1.776966364 podStartE2EDuration="3.496978468s" podCreationTimestamp="2026-05-20 20:56:54 +0000 UTC" firstStartedPulling="2026-05-20 20:56:54.862481999 +0000 UTC m=+487.792078716" lastFinishedPulling="2026-05-20 20:56:56.5824941 +0000 UTC m=+489.512090820" observedRunningTime="2026-05-20 20:56:57.493385095 +0000 UTC m=+490.422981835" watchObservedRunningTime="2026-05-20 20:56:57.496978468 +0000 UTC m=+490.426575208"
May 20 20:57:02.363701 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:02.363648    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5486cd7785-rwgsb" podStartSLOduration=6.363632193 podStartE2EDuration="6.363632193s" podCreationTimestamp="2026-05-20 20:56:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:56:57.525301729 +0000 UTC m=+490.454898470" watchObservedRunningTime="2026-05-20 20:57:02.363632193 +0000 UTC m=+495.293228933"
May 20 20:57:02.365691 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:02.365671    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth"]
May 20 20:57:02.369379 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:02.369358    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth"
May 20 20:57:02.372073 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:02.372054    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j8vhm\""
May 20 20:57:02.372377 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:02.372359    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 20 20:57:02.381381 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:02.381361    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth"]
May 20 20:57:02.481369 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:02.481330    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt48g\" (UniqueName: \"kubernetes.io/projected/daab3063-72ac-441c-8dea-24ea1958c7f1-kube-api-access-dt48g\") pod \"dns-operator-controller-manager-648d5c98bc-2lqth\" (UID: \"daab3063-72ac-441c-8dea-24ea1958c7f1\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth"
May 20 20:57:02.582927 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:02.582897    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dt48g\" (UniqueName: \"kubernetes.io/projected/daab3063-72ac-441c-8dea-24ea1958c7f1-kube-api-access-dt48g\") pod \"dns-operator-controller-manager-648d5c98bc-2lqth\" (UID: \"daab3063-72ac-441c-8dea-24ea1958c7f1\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth"
May 20 20:57:02.595521 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:02.595493    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt48g\" (UniqueName: \"kubernetes.io/projected/daab3063-72ac-441c-8dea-24ea1958c7f1-kube-api-access-dt48g\") pod \"dns-operator-controller-manager-648d5c98bc-2lqth\" (UID: \"daab3063-72ac-441c-8dea-24ea1958c7f1\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth"
May 20 20:57:02.680545 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:02.680519    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth"
May 20 20:57:02.816191 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:02.816159    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth"]
May 20 20:57:02.818627 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:57:02.818591    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaab3063_72ac_441c_8dea_24ea1958c7f1.slice/crio-b45c97310218a544dce741c3d0948abdd9e83aae6db79c85d34ae16378a14ee1 WatchSource:0}: Error finding container b45c97310218a544dce741c3d0948abdd9e83aae6db79c85d34ae16378a14ee1: Status 404 returned error can't find the container with id b45c97310218a544dce741c3d0948abdd9e83aae6db79c85d34ae16378a14ee1
May 20 20:57:03.490226 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:03.490191    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth" event={"ID":"daab3063-72ac-441c-8dea-24ea1958c7f1","Type":"ContainerStarted","Data":"b45c97310218a544dce741c3d0948abdd9e83aae6db79c85d34ae16378a14ee1"}
May 20 20:57:05.501994 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:05.501920    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth" event={"ID":"daab3063-72ac-441c-8dea-24ea1958c7f1","Type":"ContainerStarted","Data":"351d5e45daee9d4b09a691d22456d59854ca7d714818d9aa90245cc8be94b523"}
May 20 20:57:05.502480 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:05.502024    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth"
May 20 20:57:05.864683 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:05.864583    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth" podStartSLOduration=1.552320092 podStartE2EDuration="3.86456885s" podCreationTimestamp="2026-05-20 20:57:02 +0000 UTC" firstStartedPulling="2026-05-20 20:57:02.820494856 +0000 UTC m=+495.750091574" lastFinishedPulling="2026-05-20 20:57:05.132743615 +0000 UTC m=+498.062340332" observedRunningTime="2026-05-20 20:57:05.534204913 +0000 UTC m=+498.463801651" watchObservedRunningTime="2026-05-20 20:57:05.86456885 +0000 UTC m=+498.794165593"
May 20 20:57:05.865009 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:05.864994    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-295cb"]
May 20 20:57:05.868652 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:05.868633    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-295cb"
May 20 20:57:05.871333 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:05.871312    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jlt2k\""
May 20 20:57:05.888356 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:05.888336    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-295cb"]
May 20 20:57:05.909844 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:05.909813    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwp7b\" (UniqueName: \"kubernetes.io/projected/e2994bd0-8a00-4e19-8dca-63bc18359548-kube-api-access-gwp7b\") pod \"authorino-operator-657f44b778-295cb\" (UID: \"e2994bd0-8a00-4e19-8dca-63bc18359548\") " pod="kuadrant-system/authorino-operator-657f44b778-295cb"
May 20 20:57:06.011540 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:06.011492    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwp7b\" (UniqueName: \"kubernetes.io/projected/e2994bd0-8a00-4e19-8dca-63bc18359548-kube-api-access-gwp7b\") pod \"authorino-operator-657f44b778-295cb\" (UID: \"e2994bd0-8a00-4e19-8dca-63bc18359548\") " pod="kuadrant-system/authorino-operator-657f44b778-295cb"
May 20 20:57:06.021301 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:06.021272    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwp7b\" (UniqueName: \"kubernetes.io/projected/e2994bd0-8a00-4e19-8dca-63bc18359548-kube-api-access-gwp7b\") pod \"authorino-operator-657f44b778-295cb\" (UID: \"e2994bd0-8a00-4e19-8dca-63bc18359548\") " pod="kuadrant-system/authorino-operator-657f44b778-295cb"
May 20 20:57:06.179206 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:06.179169    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-295cb"
May 20 20:57:06.316363 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:06.316338    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-295cb"]
May 20 20:57:06.318558 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:57:06.318528    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2994bd0_8a00_4e19_8dca_63bc18359548.slice/crio-8090b35e2d4994ce732ecc7dbe95cfd2491e11c0ec6b5bcc2812921b149cc92b WatchSource:0}: Error finding container 8090b35e2d4994ce732ecc7dbe95cfd2491e11c0ec6b5bcc2812921b149cc92b: Status 404 returned error can't find the container with id 8090b35e2d4994ce732ecc7dbe95cfd2491e11c0ec6b5bcc2812921b149cc92b
May 20 20:57:06.506816 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:06.506727    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-295cb" event={"ID":"e2994bd0-8a00-4e19-8dca-63bc18359548","Type":"ContainerStarted","Data":"8090b35e2d4994ce732ecc7dbe95cfd2491e11c0ec6b5bcc2812921b149cc92b"}
May 20 20:57:06.734208 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:06.734161    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:57:06.734208 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:06.734214    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:57:06.740661 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:06.740629    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:57:07.519115 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:07.519082    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5486cd7785-rwgsb"
May 20 20:57:07.589384 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:07.589051    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65964847cc-jrr69"]
May 20 20:57:08.471534 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:08.471512    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"
May 20 20:57:08.520638 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:08.520605    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-295cb" event={"ID":"e2994bd0-8a00-4e19-8dca-63bc18359548","Type":"ContainerStarted","Data":"401142449f3232b963ddfec956b9a7f72b53b9e53329369498b846c98c70d880"}
May 20 20:57:08.560039 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:08.559990    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-295cb" podStartSLOduration=1.507240016 podStartE2EDuration="3.559975786s" podCreationTimestamp="2026-05-20 20:57:05 +0000 UTC" firstStartedPulling="2026-05-20 20:57:06.320601714 +0000 UTC m=+499.250198432" lastFinishedPulling="2026-05-20 20:57:08.373337471 +0000 UTC m=+501.302934202" observedRunningTime="2026-05-20 20:57:08.558225922 +0000 UTC m=+501.487822662" watchObservedRunningTime="2026-05-20 20:57:08.559975786 +0000 UTC m=+501.489572525"
May 20 20:57:09.524516 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:09.524485    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-295cb"
May 20 20:57:16.509154 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:16.509125    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-2lqth"
May 20 20:57:19.019148 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.019114    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"]
May 20 20:57:19.019581 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.019373    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn" podUID="06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c" containerName="manager" containerID="cri-o://05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49" gracePeriod=2
May 20 20:57:19.032832 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.032765    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"]
May 20 20:57:19.047064 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.047035    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs"]
May 20 20:57:19.047499 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.047482    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c" containerName="manager"
May 20 20:57:19.047499 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.047501    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c" containerName="manager"
May 20 20:57:19.047646 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.047614    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c" containerName="manager"
May 20 20:57:19.049615 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.049597    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs"
May 20 20:57:19.051986 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.051958    2556 status_manager.go:895] "Failed to get status for pod" podUID="06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn" err="pods \"limitador-operator-controller-manager-85c4996f8c-d5jgn\" is forbidden: User \"system:node:ip-10-0-142-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-248.ec2.internal' and this object"
May 20 20:57:19.060861 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.060836    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs"]
May 20 20:57:19.132546 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.132510    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj2f5\" (UniqueName: \"kubernetes.io/projected/b74e5e8d-aa64-4da7-a008-6921481987cd-kube-api-access-tj2f5\") pod \"limitador-operator-controller-manager-85c4996f8c-pf8xs\" (UID: \"b74e5e8d-aa64-4da7-a008-6921481987cd\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs"
May 20 20:57:19.233817 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.233783    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tj2f5\" (UniqueName: \"kubernetes.io/projected/b74e5e8d-aa64-4da7-a008-6921481987cd-kube-api-access-tj2f5\") pod \"limitador-operator-controller-manager-85c4996f8c-pf8xs\" (UID: \"b74e5e8d-aa64-4da7-a008-6921481987cd\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs"
May 20 20:57:19.247785 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.247753    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj2f5\" (UniqueName: \"kubernetes.io/projected/b74e5e8d-aa64-4da7-a008-6921481987cd-kube-api-access-tj2f5\") pod \"limitador-operator-controller-manager-85c4996f8c-pf8xs\" (UID: \"b74e5e8d-aa64-4da7-a008-6921481987cd\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs"
May 20 20:57:19.265706 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.265681    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"
May 20 20:57:19.268235 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.268209    2556 status_manager.go:895] "Failed to get status for pod" podUID="06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn" err="pods \"limitador-operator-controller-manager-85c4996f8c-d5jgn\" is forbidden: User \"system:node:ip-10-0-142-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-248.ec2.internal' and this object"
May 20 20:57:19.334842 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.334752    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plb4p\" (UniqueName: \"kubernetes.io/projected/06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c-kube-api-access-plb4p\") pod \"06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c\" (UID: \"06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c\") "
May 20 20:57:19.336877 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.336841    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c-kube-api-access-plb4p" (OuterVolumeSpecName: "kube-api-access-plb4p") pod "06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c" (UID: "06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c"). InnerVolumeSpecName "kube-api-access-plb4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:57:19.413234 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.413197    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs"
May 20 20:57:19.435893 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.435864    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plb4p\" (UniqueName: \"kubernetes.io/projected/06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c-kube-api-access-plb4p\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:57:19.554464 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.554420    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs"]
May 20 20:57:19.555269 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:57:19.555240    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74e5e8d_aa64_4da7_a008_6921481987cd.slice/crio-8054404d16f0e84a4484ee1cddfb1bd811929e113f19c599e5647d84366813f4 WatchSource:0}: Error finding container 8054404d16f0e84a4484ee1cddfb1bd811929e113f19c599e5647d84366813f4: Status 404 returned error can't find the container with id 8054404d16f0e84a4484ee1cddfb1bd811929e113f19c599e5647d84366813f4
May 20 20:57:19.561656 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.561624    2556 generic.go:358] "Generic (PLEG): container finished" podID="06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c" containerID="05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49" exitCode=0
May 20 20:57:19.561730 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.561679    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn"
May 20 20:57:19.561730 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.561705    2556 scope.go:117] "RemoveContainer" containerID="05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49"
May 20 20:57:19.562929 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.562904    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs" event={"ID":"b74e5e8d-aa64-4da7-a008-6921481987cd","Type":"ContainerStarted","Data":"8054404d16f0e84a4484ee1cddfb1bd811929e113f19c599e5647d84366813f4"}
May 20 20:57:19.565293 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.565263    2556 status_manager.go:895] "Failed to get status for pod" podUID="06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn" err="pods \"limitador-operator-controller-manager-85c4996f8c-d5jgn\" is forbidden: User \"system:node:ip-10-0-142-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-248.ec2.internal' and this object"
May 20 20:57:19.572775 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.572745    2556 scope.go:117] "RemoveContainer" containerID="05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49"
May 20 20:57:19.573056 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:57:19.573034    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49\": container with ID starting with 05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49 not found: ID does not exist" containerID="05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49"
May 20 20:57:19.573139 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.573067    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49"} err="failed to get container status \"05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49\": rpc error: code = NotFound desc = could not find container \"05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49\": container with ID starting with 05474ca01c5af0dd7ac3d7d88b3b73f42541f69105e807983514cc1d0e650f49 not found: ID does not exist"
May 20 20:57:19.575421 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.575389    2556 status_manager.go:895] "Failed to get status for pod" podUID="06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-d5jgn" err="pods \"limitador-operator-controller-manager-85c4996f8c-d5jgn\" is forbidden: User \"system:node:ip-10-0-142-248.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-248.ec2.internal' and this object"
May 20 20:57:19.675425 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:19.675394    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c" path="/var/lib/kubelet/pods/06dbf99d-9bd8-4f5f-9f8b-22da2ec50f5c/volumes"
May 20 20:57:20.530024 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:20.529991    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-295cb"
May 20 20:57:20.569179 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:20.569148    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs" event={"ID":"b74e5e8d-aa64-4da7-a008-6921481987cd","Type":"ContainerStarted","Data":"d740bdff7b27919359b1f8b5b37e62a6ec30d71246aea79600df8fdead25fe46"}
May 20 20:57:20.569345 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:20.569248    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs"
May 20 20:57:20.595418 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:20.595368    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs" podStartSLOduration=1.595355021 podStartE2EDuration="1.595355021s" podCreationTimestamp="2026-05-20 20:57:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:57:20.592627551 +0000 UTC m=+513.522224290" watchObservedRunningTime="2026-05-20 20:57:20.595355021 +0000 UTC m=+513.524951760"
May 20 20:57:31.575343 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:31.575307    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pf8xs"
May 20 20:57:32.621023 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.620967    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-65964847cc-jrr69" podUID="c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" containerName="console" containerID="cri-o://f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199" gracePeriod=15
May 20 20:57:32.871307 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.871245    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65964847cc-jrr69_c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9/console/0.log"
May 20 20:57:32.871414 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.871308    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65964847cc-jrr69"
May 20 20:57:32.952263 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952229    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-oauth-serving-cert\") pod \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") "
May 20 20:57:32.952419 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952276    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-trusted-ca-bundle\") pod \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") "
May 20 20:57:32.952419 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952316    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb22c\" (UniqueName: \"kubernetes.io/projected/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-kube-api-access-wb22c\") pod \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") "
May 20 20:57:32.952419 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952351    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-oauth-config\") pod \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") "
May 20 20:57:32.952419 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952371    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-config\") pod \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") "
May 20 20:57:32.952601 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952417    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-serving-cert\") pod \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") "
May 20 20:57:32.952601 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952485    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-service-ca\") pod \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\" (UID: \"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9\") "
May 20 20:57:32.952671 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952597    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" (UID: "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:57:32.952840 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952817    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-oauth-serving-cert\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:57:32.952840 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952817    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" (UID: "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:57:32.953032 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952834    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-config" (OuterVolumeSpecName: "console-config") pod "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" (UID: "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:57:32.953032 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.952930    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" (UID: "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:57:32.954622 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.954594    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-kube-api-access-wb22c" (OuterVolumeSpecName: "kube-api-access-wb22c") pod "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" (UID: "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9"). InnerVolumeSpecName "kube-api-access-wb22c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:57:32.954734 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.954711    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" (UID: "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:57:32.954782 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:32.954764    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" (UID: "c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:57:33.053286 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.053245    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-trusted-ca-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:57:33.053286 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.053279    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb22c\" (UniqueName: \"kubernetes.io/projected/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-kube-api-access-wb22c\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:57:33.053530 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.053295    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-oauth-config\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:57:33.053530 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.053309    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-config\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:57:33.053530 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.053322    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-console-serving-cert\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:57:33.053530 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.053334    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9-service-ca\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:57:33.627215 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.627188    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65964847cc-jrr69_c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9/console/0.log"
May 20 20:57:33.627677 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.627231    2556 generic.go:358] "Generic (PLEG): container finished" podID="c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" containerID="f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199" exitCode=2
May 20 20:57:33.627677 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.627284    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65964847cc-jrr69" event={"ID":"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9","Type":"ContainerDied","Data":"f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199"}
May 20 20:57:33.627677 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.627306    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65964847cc-jrr69"
May 20 20:57:33.627677 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.627312    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65964847cc-jrr69" event={"ID":"c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9","Type":"ContainerDied","Data":"05491735afdf901267e536df5ae76ce1be3e8a70b5b2119f6a909b7afec7439c"}
May 20 20:57:33.627677 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.627331    2556 scope.go:117] "RemoveContainer" containerID="f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199"
May 20 20:57:33.636351 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.636339    2556 scope.go:117] "RemoveContainer" containerID="f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199"
May 20 20:57:33.636654 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:57:33.636636    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199\": container with ID starting with f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199 not found: ID does not exist" containerID="f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199"
May 20 20:57:33.636714 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.636661    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199"} err="failed to get container status \"f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199\": rpc error: code = NotFound desc = could not find container \"f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199\": container with ID starting with f7e2e84c29f534b51dfb8bea3c14330f9dcb4c5b086aa2e4582b2f2ae3319199 not found: ID does not exist"
May 20 20:57:33.652733 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.652702    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65964847cc-jrr69"]
May 20 20:57:33.661197 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.661175    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65964847cc-jrr69"]
May 20 20:57:33.675951 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:33.675926    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" path="/var/lib/kubelet/pods/c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9/volumes"
May 20 20:57:48.927509 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.927481    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"]
May 20 20:57:48.928286 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.928266    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" containerName="console"
May 20 20:57:48.928286 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.928286    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" containerName="console"
May 20 20:57:48.928474 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.928377    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5021ed6-25d2-4c0f-a54a-8b0e0a1379a9" containerName="console"
May 20 20:57:48.936838 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.936813    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:48.945840 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.945814    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tt9pg\""
May 20 20:57:48.946360 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.946269    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"]
May 20 20:57:48.999734 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.999701    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:48.999910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.999749    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:48.999910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.999772    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:48.999910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.999793    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jppsb\" (UniqueName: \"kubernetes.io/projected/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-kube-api-access-jppsb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:48.999910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.999869    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:48.999910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.999890    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:48.999910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.999912    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.000104 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:48.999962    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.000104 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.000005    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.100636 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.100589    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.100636 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.100636    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.100910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.100669    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.100910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.100698    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.100910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.100730    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.100910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.100754    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.100910 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.100780    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jppsb\" (UniqueName: \"kubernetes.io/projected/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-kube-api-access-jppsb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.101150 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.100995    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.101150 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.101019    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.101150 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.101035    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.101251 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.101190    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.101307 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.101286    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.101356 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.101342    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.101680 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.101661    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.103126 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.103101    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.103228 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.103131    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.112586 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.112553    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jppsb\" (UniqueName: \"kubernetes.io/projected/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-kube-api-access-jppsb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.112677 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.112586    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9b3607d-c1b2-49ec-adae-dcf1005c67d2-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-2hw6v\" (UID: \"e9b3607d-c1b2-49ec-adae-dcf1005c67d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.250500 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.250397    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:49.387310 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.387280    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"]
May 20 20:57:49.388424 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:57:49.388395    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b3607d_c1b2_49ec_adae_dcf1005c67d2.slice/crio-a22a4480a9249584a008625459cea7211c0c28e89935c7180829646f6e78a9f7 WatchSource:0}: Error finding container a22a4480a9249584a008625459cea7211c0c28e89935c7180829646f6e78a9f7: Status 404 returned error can't find the container with id a22a4480a9249584a008625459cea7211c0c28e89935c7180829646f6e78a9f7
May 20 20:57:49.390685 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.390651    2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 20 20:57:49.390761 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.390714    2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 20 20:57:49.390761 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.390740    2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 20 20:57:49.688872 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.688838    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v" event={"ID":"e9b3607d-c1b2-49ec-adae-dcf1005c67d2","Type":"ContainerStarted","Data":"e6f298e934923ffe38ef5317628a7b71cbd91d5e20f111f0ef99e41255bc3e2d"}
May 20 20:57:49.688872 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.688873    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v" event={"ID":"e9b3607d-c1b2-49ec-adae-dcf1005c67d2","Type":"ContainerStarted","Data":"a22a4480a9249584a008625459cea7211c0c28e89935c7180829646f6e78a9f7"}
May 20 20:57:49.717143 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:49.717096    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v" podStartSLOduration=1.717080439 podStartE2EDuration="1.717080439s" podCreationTimestamp="2026-05-20 20:57:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:57:49.714899652 +0000 UTC m=+542.644496391" watchObservedRunningTime="2026-05-20 20:57:49.717080439 +0000 UTC m=+542.646677178"
May 20 20:57:50.251452 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:50.251389    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:50.256083 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:50.256053    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:50.693344 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:50.693306    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:50.694290 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:50.694273    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-2hw6v"
May 20 20:57:53.606838 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:53.606806    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-txlsr"]
May 20 20:57:53.610587 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:53.610568    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-txlsr"
May 20 20:57:53.614051 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:53.614028    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5mcs2\""
May 20 20:57:53.621269 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:53.620424    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-txlsr"]
May 20 20:57:53.640333 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:53.640305    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t872j\" (UniqueName: \"kubernetes.io/projected/8b0d81e6-d5cf-4f71-b567-3f318ae4d171-kube-api-access-t872j\") pod \"authorino-f99f4b5cd-txlsr\" (UID: \"8b0d81e6-d5cf-4f71-b567-3f318ae4d171\") " pod="kuadrant-system/authorino-f99f4b5cd-txlsr"
May 20 20:57:53.741760 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:53.741725    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t872j\" (UniqueName: \"kubernetes.io/projected/8b0d81e6-d5cf-4f71-b567-3f318ae4d171-kube-api-access-t872j\") pod \"authorino-f99f4b5cd-txlsr\" (UID: \"8b0d81e6-d5cf-4f71-b567-3f318ae4d171\") " pod="kuadrant-system/authorino-f99f4b5cd-txlsr"
May 20 20:57:53.757466 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:53.757414    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t872j\" (UniqueName: \"kubernetes.io/projected/8b0d81e6-d5cf-4f71-b567-3f318ae4d171-kube-api-access-t872j\") pod \"authorino-f99f4b5cd-txlsr\" (UID: \"8b0d81e6-d5cf-4f71-b567-3f318ae4d171\") " pod="kuadrant-system/authorino-f99f4b5cd-txlsr"
May 20 20:57:53.930066 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:53.930035    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-txlsr"
May 20 20:57:54.061032 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:54.061006    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-txlsr"]
May 20 20:57:54.063003 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:57:54.062972    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b0d81e6_d5cf_4f71_b567_3f318ae4d171.slice/crio-f90d403377a03a5738ac932d62859c4faf17f30c27f168a811c305507061ff32 WatchSource:0}: Error finding container f90d403377a03a5738ac932d62859c4faf17f30c27f168a811c305507061ff32: Status 404 returned error can't find the container with id f90d403377a03a5738ac932d62859c4faf17f30c27f168a811c305507061ff32
May 20 20:57:54.711799 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:54.711760    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-txlsr" event={"ID":"8b0d81e6-d5cf-4f71-b567-3f318ae4d171","Type":"ContainerStarted","Data":"f90d403377a03a5738ac932d62859c4faf17f30c27f168a811c305507061ff32"}
May 20 20:57:57.726554 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:57.726519    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-txlsr" event={"ID":"8b0d81e6-d5cf-4f71-b567-3f318ae4d171","Type":"ContainerStarted","Data":"3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24"}
May 20 20:57:57.746533 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:57.746477    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-txlsr" podStartSLOduration=1.733775013 podStartE2EDuration="4.746424729s" podCreationTimestamp="2026-05-20 20:57:53 +0000 UTC" firstStartedPulling="2026-05-20 20:57:54.064778198 +0000 UTC m=+546.994374915" lastFinishedPulling="2026-05-20 20:57:57.077427904 +0000 UTC m=+550.007024631" observedRunningTime="2026-05-20 20:57:57.744557804 +0000 UTC m=+550.674154544" watchObservedRunningTime="2026-05-20 20:57:57.746424729 +0000 UTC m=+550.676021488"
May 20 20:57:59.029660 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:59.029624    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-txlsr"]
May 20 20:57:59.735133 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:59.735086    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-txlsr" podUID="8b0d81e6-d5cf-4f71-b567-3f318ae4d171" containerName="authorino" containerID="cri-o://3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24" gracePeriod=30
May 20 20:57:59.972169 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:57:59.972143    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-txlsr"
May 20 20:58:00.000258 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.000192    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t872j\" (UniqueName: \"kubernetes.io/projected/8b0d81e6-d5cf-4f71-b567-3f318ae4d171-kube-api-access-t872j\") pod \"8b0d81e6-d5cf-4f71-b567-3f318ae4d171\" (UID: \"8b0d81e6-d5cf-4f71-b567-3f318ae4d171\") "
May 20 20:58:00.002258 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.002233    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b0d81e6-d5cf-4f71-b567-3f318ae4d171-kube-api-access-t872j" (OuterVolumeSpecName: "kube-api-access-t872j") pod "8b0d81e6-d5cf-4f71-b567-3f318ae4d171" (UID: "8b0d81e6-d5cf-4f71-b567-3f318ae4d171"). InnerVolumeSpecName "kube-api-access-t872j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:58:00.101264 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.101215    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t872j\" (UniqueName: \"kubernetes.io/projected/8b0d81e6-d5cf-4f71-b567-3f318ae4d171-kube-api-access-t872j\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:58:00.740046 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.740010    2556 generic.go:358] "Generic (PLEG): container finished" podID="8b0d81e6-d5cf-4f71-b567-3f318ae4d171" containerID="3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24" exitCode=0
May 20 20:58:00.740246 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.740058    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-txlsr"
May 20 20:58:00.740246 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.740064    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-txlsr" event={"ID":"8b0d81e6-d5cf-4f71-b567-3f318ae4d171","Type":"ContainerDied","Data":"3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24"}
May 20 20:58:00.740246 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.740149    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-txlsr" event={"ID":"8b0d81e6-d5cf-4f71-b567-3f318ae4d171","Type":"ContainerDied","Data":"f90d403377a03a5738ac932d62859c4faf17f30c27f168a811c305507061ff32"}
May 20 20:58:00.740246 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.740164    2556 scope.go:117] "RemoveContainer" containerID="3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24"
May 20 20:58:00.749496 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.749476    2556 scope.go:117] "RemoveContainer" containerID="3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24"
May 20 20:58:00.749768 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:58:00.749748    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24\": container with ID starting with 3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24 not found: ID does not exist" containerID="3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24"
May 20 20:58:00.749834 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.749775    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24"} err="failed to get container status \"3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24\": rpc error: code = NotFound desc = could not find container \"3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24\": container with ID starting with 3b73621ac8e05a69ec62323d90b2dbac9be6f07e7de5404f50b3f4384deeaa24 not found: ID does not exist"
May 20 20:58:00.765003 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.764977    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-txlsr"]
May 20 20:58:00.772819 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:00.772798    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-txlsr"]
May 20 20:58:01.675366 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:01.675328    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b0d81e6-d5cf-4f71-b567-3f318ae4d171" path="/var/lib/kubelet/pods/8b0d81e6-d5cf-4f71-b567-3f318ae4d171/volumes"
May 20 20:58:27.907450 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:27.907408    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"]
May 20 20:58:27.907860 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:27.907797    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0d81e6-d5cf-4f71-b567-3f318ae4d171" containerName="authorino"
May 20 20:58:27.907860 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:27.907809    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0d81e6-d5cf-4f71-b567-3f318ae4d171" containerName="authorino"
May 20 20:58:27.907940 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:27.907872    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b0d81e6-d5cf-4f71-b567-3f318ae4d171" containerName="authorino"
May 20 20:58:27.915674 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:27.915652    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:27.918660 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:27.918638    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 20:58:27.919661 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:27.919642    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 20:58:27.922088 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:27.922065    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cqs\""
May 20 20:58:27.924735 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:27.924704    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"]
May 20 20:58:28.048923 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.048898    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-bundle\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:28.049063 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.048957    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfsnj\" (UniqueName: \"kubernetes.io/projected/9d00c5d2-1973-4262-907d-e4aaab28d7ab-kube-api-access-wfsnj\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:28.049063 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.049036    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-util\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:28.149961 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.149925    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-util\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:28.150080 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.149978    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-bundle\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:28.150080 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.150021    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wfsnj\" (UniqueName: \"kubernetes.io/projected/9d00c5d2-1973-4262-907d-e4aaab28d7ab-kube-api-access-wfsnj\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:28.150311 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.150293    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-util\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:28.150348 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.150319    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-bundle\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:28.162060 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.161999    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfsnj\" (UniqueName: \"kubernetes.io/projected/9d00c5d2-1973-4262-907d-e4aaab28d7ab-kube-api-access-wfsnj\") pod \"7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") " pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:28.225549 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.225527    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:28.359363 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.359334    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"]
May 20 20:58:28.360249 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:58:28.360224    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d00c5d2_1973_4262_907d_e4aaab28d7ab.slice/crio-065c6a6e7a37d4fa2dc3f2df46d21db85a4c87db90ed380b9f1ea7c126a48ce5 WatchSource:0}: Error finding container 065c6a6e7a37d4fa2dc3f2df46d21db85a4c87db90ed380b9f1ea7c126a48ce5: Status 404 returned error can't find the container with id 065c6a6e7a37d4fa2dc3f2df46d21db85a4c87db90ed380b9f1ea7c126a48ce5
May 20 20:58:28.853600 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.853519    2556 generic.go:358] "Generic (PLEG): container finished" podID="9d00c5d2-1973-4262-907d-e4aaab28d7ab" containerID="b90dbd5ff91fcf39df518ab9369262cf6b99fd9918baf53b14119f1c20242245" exitCode=0
May 20 20:58:28.853760 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.853609    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s" event={"ID":"9d00c5d2-1973-4262-907d-e4aaab28d7ab","Type":"ContainerDied","Data":"b90dbd5ff91fcf39df518ab9369262cf6b99fd9918baf53b14119f1c20242245"}
May 20 20:58:28.853760 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:28.853650    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s" event={"ID":"9d00c5d2-1973-4262-907d-e4aaab28d7ab","Type":"ContainerStarted","Data":"065c6a6e7a37d4fa2dc3f2df46d21db85a4c87db90ed380b9f1ea7c126a48ce5"}
May 20 20:58:29.858949 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:29.858859    2556 generic.go:358] "Generic (PLEG): container finished" podID="9d00c5d2-1973-4262-907d-e4aaab28d7ab" containerID="9685aaaa5de93356d69890eeb07947fe2c673e868f8c318bc28dd418243589c2" exitCode=0
May 20 20:58:29.858949 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:29.858940    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s" event={"ID":"9d00c5d2-1973-4262-907d-e4aaab28d7ab","Type":"ContainerDied","Data":"9685aaaa5de93356d69890eeb07947fe2c673e868f8c318bc28dd418243589c2"}
May 20 20:58:30.864885 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:30.864852    2556 generic.go:358] "Generic (PLEG): container finished" podID="9d00c5d2-1973-4262-907d-e4aaab28d7ab" containerID="6e761f920e602751a5cb10184986cdcab721239e53aef589c6cb956bb6b3e486" exitCode=0
May 20 20:58:30.865328 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:30.864903    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s" event={"ID":"9d00c5d2-1973-4262-907d-e4aaab28d7ab","Type":"ContainerDied","Data":"6e761f920e602751a5cb10184986cdcab721239e53aef589c6cb956bb6b3e486"}
May 20 20:58:31.997253 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:31.997228    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:32.181985 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.181961    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-bundle\") pod \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") "
May 20 20:58:32.182142 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.182037    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfsnj\" (UniqueName: \"kubernetes.io/projected/9d00c5d2-1973-4262-907d-e4aaab28d7ab-kube-api-access-wfsnj\") pod \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") "
May 20 20:58:32.182142 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.182063    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-util\") pod \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\" (UID: \"9d00c5d2-1973-4262-907d-e4aaab28d7ab\") "
May 20 20:58:32.182568 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.182543    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-bundle" (OuterVolumeSpecName: "bundle") pod "9d00c5d2-1973-4262-907d-e4aaab28d7ab" (UID: "9d00c5d2-1973-4262-907d-e4aaab28d7ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:58:32.184022 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.184002    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d00c5d2-1973-4262-907d-e4aaab28d7ab-kube-api-access-wfsnj" (OuterVolumeSpecName: "kube-api-access-wfsnj") pod "9d00c5d2-1973-4262-907d-e4aaab28d7ab" (UID: "9d00c5d2-1973-4262-907d-e4aaab28d7ab"). InnerVolumeSpecName "kube-api-access-wfsnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:58:32.187957 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.187932    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-util" (OuterVolumeSpecName: "util") pod "9d00c5d2-1973-4262-907d-e4aaab28d7ab" (UID: "9d00c5d2-1973-4262-907d-e4aaab28d7ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:58:32.282853 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.282825    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfsnj\" (UniqueName: \"kubernetes.io/projected/9d00c5d2-1973-4262-907d-e4aaab28d7ab-kube-api-access-wfsnj\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:58:32.282853 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.282849    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:58:32.282853 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.282858    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9d00c5d2-1973-4262-907d-e4aaab28d7ab-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:58:32.875221 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.875191    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s"
May 20 20:58:32.875417 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.875193    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/7471e62b3b524e5f63095613ed1aa2d2aa2beb9d9bc7600d699dae135066m9s" event={"ID":"9d00c5d2-1973-4262-907d-e4aaab28d7ab","Type":"ContainerDied","Data":"065c6a6e7a37d4fa2dc3f2df46d21db85a4c87db90ed380b9f1ea7c126a48ce5"}
May 20 20:58:32.875417 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:32.875302    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="065c6a6e7a37d4fa2dc3f2df46d21db85a4c87db90ed380b9f1ea7c126a48ce5"
May 20 20:58:51.665886 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.665844    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:58:51.666303 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.666267    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d00c5d2-1973-4262-907d-e4aaab28d7ab" containerName="extract"
May 20 20:58:51.666303 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.666278    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d00c5d2-1973-4262-907d-e4aaab28d7ab" containerName="extract"
May 20 20:58:51.666303 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.666303    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d00c5d2-1973-4262-907d-e4aaab28d7ab" containerName="pull"
May 20 20:58:51.666566 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.666308    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d00c5d2-1973-4262-907d-e4aaab28d7ab" containerName="pull"
May 20 20:58:51.666566 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.666318    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d00c5d2-1973-4262-907d-e4aaab28d7ab" containerName="util"
May 20 20:58:51.666566 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.666323    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d00c5d2-1973-4262-907d-e4aaab28d7ab" containerName="util"
May 20 20:58:51.666566 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.666384    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9d00c5d2-1973-4262-907d-e4aaab28d7ab" containerName="extract"
May 20 20:58:51.670409 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.670391    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 20:58:51.677841 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.677808    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 20 20:58:51.677991 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.677847    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-kxnff\""
May 20 20:58:51.678549 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.678521    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
May 20 20:58:51.678961 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.678942    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 20 20:58:51.687937 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.687898    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:58:51.755835 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.755799    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcjj6\" (UniqueName: \"kubernetes.io/projected/c1dc008d-db14-4548-aa97-b80aa365cd40-kube-api-access-bcjj6\") pod \"maas-keycloak-0\" (UID: \"c1dc008d-db14-4548-aa97-b80aa365cd40\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:58:51.857194 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.857156    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcjj6\" (UniqueName: \"kubernetes.io/projected/c1dc008d-db14-4548-aa97-b80aa365cd40-kube-api-access-bcjj6\") pod \"maas-keycloak-0\" (UID: \"c1dc008d-db14-4548-aa97-b80aa365cd40\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:58:51.867615 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.867587    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcjj6\" (UniqueName: \"kubernetes.io/projected/c1dc008d-db14-4548-aa97-b80aa365cd40-kube-api-access-bcjj6\") pod \"maas-keycloak-0\" (UID: \"c1dc008d-db14-4548-aa97-b80aa365cd40\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:58:51.988193 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:51.988094    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 20:58:52.125264 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:52.125234    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:58:52.126852 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:58:52.126824    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1dc008d_db14_4548_aa97_b80aa365cd40.slice/crio-f14c634bd1f5e0ed0cf406cc652c15fd2b1a2768fcfc634a88dd4cba05d4f0eb WatchSource:0}: Error finding container f14c634bd1f5e0ed0cf406cc652c15fd2b1a2768fcfc634a88dd4cba05d4f0eb: Status 404 returned error can't find the container with id f14c634bd1f5e0ed0cf406cc652c15fd2b1a2768fcfc634a88dd4cba05d4f0eb
May 20 20:58:52.956939 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:52.956886    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c1dc008d-db14-4548-aa97-b80aa365cd40","Type":"ContainerStarted","Data":"f14c634bd1f5e0ed0cf406cc652c15fd2b1a2768fcfc634a88dd4cba05d4f0eb"}
May 20 20:58:57.984800 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:57.984764    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c1dc008d-db14-4548-aa97-b80aa365cd40","Type":"ContainerStarted","Data":"49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e"}
May 20 20:58:57.988625 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:57.988601    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
May 20 20:58:57.990116 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:57.990084    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:58:58.009984 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:58.009916    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.099254707 podStartE2EDuration="7.009897813s" podCreationTimestamp="2026-05-20 20:58:51 +0000 UTC" firstStartedPulling="2026-05-20 20:58:52.128188124 +0000 UTC m=+605.057784841" lastFinishedPulling="2026-05-20 20:58:57.03883123 +0000 UTC m=+609.968427947" observedRunningTime="2026-05-20 20:58:58.006457846 +0000 UTC m=+610.936054585" watchObservedRunningTime="2026-05-20 20:58:58.009897813 +0000 UTC m=+610.939494552"
May 20 20:58:58.994615 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:58.994570    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:58:59.989487 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:58:59.989397    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:59:00.989477 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:00.989397    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:59:01.988834 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:01.988790    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
May 20 20:59:01.989199 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:01.989122    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:59:02.988994 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:02.988949    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:59:03.989214 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:03.989152    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:59:04.988590 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:04.988543    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:59:05.988539 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:05.988486    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:59:06.988894 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:06.988794    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:59:07.989357 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:07.989302    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:59:08.989374 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:08.989318    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused"
May 20 20:59:10.083584 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:10.083550    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
May 20 20:59:10.099916 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:10.099868    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:59:20.089982 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:20.089945    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
May 20 20:59:21.370483 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:21.370452    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-858d79f456-pprlf"]
May 20 20:59:21.378353 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:21.378329    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858d79f456-pprlf"
May 20 20:59:21.383573 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:21.383545    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5mcs2\""
May 20 20:59:21.387222 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:21.387197    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-858d79f456-pprlf"]
May 20 20:59:21.448312 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:21.448281    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v79hv\" (UniqueName: \"kubernetes.io/projected/f287cac7-d1b6-4d43-87bb-b3fedfeadc05-kube-api-access-v79hv\") pod \"authorino-858d79f456-pprlf\" (UID: \"f287cac7-d1b6-4d43-87bb-b3fedfeadc05\") " pod="kuadrant-system/authorino-858d79f456-pprlf"
May 20 20:59:21.548734 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:21.548701    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v79hv\" (UniqueName: \"kubernetes.io/projected/f287cac7-d1b6-4d43-87bb-b3fedfeadc05-kube-api-access-v79hv\") pod \"authorino-858d79f456-pprlf\" (UID: \"f287cac7-d1b6-4d43-87bb-b3fedfeadc05\") " pod="kuadrant-system/authorino-858d79f456-pprlf"
May 20 20:59:21.593653 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:21.593620    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v79hv\" (UniqueName: \"kubernetes.io/projected/f287cac7-d1b6-4d43-87bb-b3fedfeadc05-kube-api-access-v79hv\") pod \"authorino-858d79f456-pprlf\" (UID: \"f287cac7-d1b6-4d43-87bb-b3fedfeadc05\") " pod="kuadrant-system/authorino-858d79f456-pprlf"
May 20 20:59:21.635858 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:21.635786    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-858d79f456-pprlf"]
May 20 20:59:21.636073 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:21.636061    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858d79f456-pprlf"
May 20 20:59:21.777325 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:59:21.777296    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf287cac7_d1b6_4d43_87bb_b3fedfeadc05.slice/crio-15bf7b26f41d15ac469ee2c26b83a3c697bfef8517925a17b41c4837312e7895 WatchSource:0}: Error finding container 15bf7b26f41d15ac469ee2c26b83a3c697bfef8517925a17b41c4837312e7895: Status 404 returned error can't find the container with id 15bf7b26f41d15ac469ee2c26b83a3c697bfef8517925a17b41c4837312e7895
May 20 20:59:21.778248 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:21.778218    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-858d79f456-pprlf"]
May 20 20:59:21.778648 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:21.778629    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:59:22.107600 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:22.107566    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858d79f456-pprlf" event={"ID":"f287cac7-d1b6-4d43-87bb-b3fedfeadc05","Type":"ContainerStarted","Data":"15bf7b26f41d15ac469ee2c26b83a3c697bfef8517925a17b41c4837312e7895"}
May 20 20:59:23.112427 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:23.112385    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858d79f456-pprlf" event={"ID":"f287cac7-d1b6-4d43-87bb-b3fedfeadc05","Type":"ContainerStarted","Data":"dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544"}
May 20 20:59:23.112892 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:23.112468    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-858d79f456-pprlf" podUID="f287cac7-d1b6-4d43-87bb-b3fedfeadc05" containerName="authorino" containerID="cri-o://dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544" gracePeriod=30
May 20 20:59:23.136506 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:23.136396    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-858d79f456-pprlf" podStartSLOduration=1.810260134 podStartE2EDuration="2.136382709s" podCreationTimestamp="2026-05-20 20:59:21 +0000 UTC" firstStartedPulling="2026-05-20 20:59:21.778816863 +0000 UTC m=+634.708413580" lastFinishedPulling="2026-05-20 20:59:22.104939431 +0000 UTC m=+635.034536155" observedRunningTime="2026-05-20 20:59:23.133645331 +0000 UTC m=+636.063242070" watchObservedRunningTime="2026-05-20 20:59:23.136382709 +0000 UTC m=+636.065979448"
May 20 20:59:23.365944 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:23.365876    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858d79f456-pprlf"
May 20 20:59:23.463279 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:23.463245    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v79hv\" (UniqueName: \"kubernetes.io/projected/f287cac7-d1b6-4d43-87bb-b3fedfeadc05-kube-api-access-v79hv\") pod \"f287cac7-d1b6-4d43-87bb-b3fedfeadc05\" (UID: \"f287cac7-d1b6-4d43-87bb-b3fedfeadc05\") "
May 20 20:59:23.465238 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:23.465215    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f287cac7-d1b6-4d43-87bb-b3fedfeadc05-kube-api-access-v79hv" (OuterVolumeSpecName: "kube-api-access-v79hv") pod "f287cac7-d1b6-4d43-87bb-b3fedfeadc05" (UID: "f287cac7-d1b6-4d43-87bb-b3fedfeadc05"). InnerVolumeSpecName "kube-api-access-v79hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:59:23.564615 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:23.564585    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v79hv\" (UniqueName: \"kubernetes.io/projected/f287cac7-d1b6-4d43-87bb-b3fedfeadc05-kube-api-access-v79hv\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:59:24.116905 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:24.116814    2556 generic.go:358] "Generic (PLEG): container finished" podID="f287cac7-d1b6-4d43-87bb-b3fedfeadc05" containerID="dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544" exitCode=0
May 20 20:59:24.116905 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:24.116866    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-858d79f456-pprlf"
May 20 20:59:24.117364 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:24.116895    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858d79f456-pprlf" event={"ID":"f287cac7-d1b6-4d43-87bb-b3fedfeadc05","Type":"ContainerDied","Data":"dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544"}
May 20 20:59:24.117364 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:24.116933    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-858d79f456-pprlf" event={"ID":"f287cac7-d1b6-4d43-87bb-b3fedfeadc05","Type":"ContainerDied","Data":"15bf7b26f41d15ac469ee2c26b83a3c697bfef8517925a17b41c4837312e7895"}
May 20 20:59:24.117364 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:24.116948    2556 scope.go:117] "RemoveContainer" containerID="dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544"
May 20 20:59:24.125530 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:24.125513    2556 scope.go:117] "RemoveContainer" containerID="dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544"
May 20 20:59:24.125763 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:59:24.125740    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544\": container with ID starting with dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544 not found: ID does not exist" containerID="dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544"
May 20 20:59:24.125818 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:24.125772    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544"} err="failed to get container status \"dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544\": rpc error: code = NotFound desc = could not find container \"dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544\": container with ID starting with dd6821e9d856e3a53cef481998025cc278d7b9aa5f76bea167a4b5770a445544 not found: ID does not exist"
May 20 20:59:24.141042 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:24.141011    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-858d79f456-pprlf"]
May 20 20:59:24.143356 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:24.143335    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-858d79f456-pprlf"]
May 20 20:59:25.676485 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:25.676451    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f287cac7-d1b6-4d43-87bb-b3fedfeadc05" path="/var/lib/kubelet/pods/f287cac7-d1b6-4d43-87bb-b3fedfeadc05/volumes"
May 20 20:59:26.513339 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.513302    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5rvpr"]
May 20 20:59:26.513751 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.513736    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f287cac7-d1b6-4d43-87bb-b3fedfeadc05" containerName="authorino"
May 20 20:59:26.513751 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.513752    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f287cac7-d1b6-4d43-87bb-b3fedfeadc05" containerName="authorino"
May 20 20:59:26.513894 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.513807    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f287cac7-d1b6-4d43-87bb-b3fedfeadc05" containerName="authorino"
May 20 20:59:26.516677 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.516656    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-5rvpr"
May 20 20:59:26.519406 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.519381    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 20 20:59:26.519537 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.519384    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tnwns\""
May 20 20:59:26.528708 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.528686    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5rvpr"]
May 20 20:59:26.586117 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.586085    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jj7p\" (UniqueName: \"kubernetes.io/projected/efea146b-019f-4a5d-883b-b38878513993-kube-api-access-6jj7p\") pod \"maas-controller-68fb5d86bc-5rvpr\" (UID: \"efea146b-019f-4a5d-883b-b38878513993\") " pod="opendatahub/maas-controller-68fb5d86bc-5rvpr"
May 20 20:59:26.676259 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.676226    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-785f576c9c-qrwtt"]
May 20 20:59:26.678773 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.678756    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785f576c9c-qrwtt"
May 20 20:59:26.686803 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.686777    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh8pv\" (UniqueName: \"kubernetes.io/projected/b447c653-7c5d-4240-8939-979fb4319694-kube-api-access-kh8pv\") pod \"maas-controller-785f576c9c-qrwtt\" (UID: \"b447c653-7c5d-4240-8939-979fb4319694\") " pod="opendatahub/maas-controller-785f576c9c-qrwtt"
May 20 20:59:26.687108 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.687085    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jj7p\" (UniqueName: \"kubernetes.io/projected/efea146b-019f-4a5d-883b-b38878513993-kube-api-access-6jj7p\") pod \"maas-controller-68fb5d86bc-5rvpr\" (UID: \"efea146b-019f-4a5d-883b-b38878513993\") " pod="opendatahub/maas-controller-68fb5d86bc-5rvpr"
May 20 20:59:26.689586 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.689565    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785f576c9c-qrwtt"]
May 20 20:59:26.698101 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.698080    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jj7p\" (UniqueName: \"kubernetes.io/projected/efea146b-019f-4a5d-883b-b38878513993-kube-api-access-6jj7p\") pod \"maas-controller-68fb5d86bc-5rvpr\" (UID: \"efea146b-019f-4a5d-883b-b38878513993\") " pod="opendatahub/maas-controller-68fb5d86bc-5rvpr"
May 20 20:59:26.787673 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.787590    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kh8pv\" (UniqueName: \"kubernetes.io/projected/b447c653-7c5d-4240-8939-979fb4319694-kube-api-access-kh8pv\") pod \"maas-controller-785f576c9c-qrwtt\" (UID: \"b447c653-7c5d-4240-8939-979fb4319694\") " pod="opendatahub/maas-controller-785f576c9c-qrwtt"
May 20 20:59:26.796507 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.796476    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5rvpr"]
May 20 20:59:26.796738 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.796726    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-5rvpr"
May 20 20:59:26.801161 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.801136    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh8pv\" (UniqueName: \"kubernetes.io/projected/b447c653-7c5d-4240-8939-979fb4319694-kube-api-access-kh8pv\") pod \"maas-controller-785f576c9c-qrwtt\" (UID: \"b447c653-7c5d-4240-8939-979fb4319694\") " pod="opendatahub/maas-controller-785f576c9c-qrwtt"
May 20 20:59:26.840668 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.840629    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b48d64b66-qtxkj"]
May 20 20:59:26.844028 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.843941    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b48d64b66-qtxkj"
May 20 20:59:26.862139 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.862098    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b48d64b66-qtxkj"]
May 20 20:59:26.888462 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.888413    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhtmk\" (UniqueName: \"kubernetes.io/projected/e08a1ae0-b13b-442d-8e28-e056e98455e6-kube-api-access-jhtmk\") pod \"maas-controller-7b48d64b66-qtxkj\" (UID: \"e08a1ae0-b13b-442d-8e28-e056e98455e6\") " pod="opendatahub/maas-controller-7b48d64b66-qtxkj"
May 20 20:59:26.989073 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.989039    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhtmk\" (UniqueName: \"kubernetes.io/projected/e08a1ae0-b13b-442d-8e28-e056e98455e6-kube-api-access-jhtmk\") pod \"maas-controller-7b48d64b66-qtxkj\" (UID: \"e08a1ae0-b13b-442d-8e28-e056e98455e6\") " pod="opendatahub/maas-controller-7b48d64b66-qtxkj"
May 20 20:59:26.989847 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.989825    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785f576c9c-qrwtt"
May 20 20:59:27.000018 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:26.999996    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhtmk\" (UniqueName: \"kubernetes.io/projected/e08a1ae0-b13b-442d-8e28-e056e98455e6-kube-api-access-jhtmk\") pod \"maas-controller-7b48d64b66-qtxkj\" (UID: \"e08a1ae0-b13b-442d-8e28-e056e98455e6\") " pod="opendatahub/maas-controller-7b48d64b66-qtxkj"
May 20 20:59:27.126582 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:27.126551    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785f576c9c-qrwtt"]
May 20 20:59:27.129518 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:59:27.129484    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb447c653_7c5d_4240_8939_979fb4319694.slice/crio-ed4375a69776d7665b7c71c4ac7f6807fdcfae607ff3c5c635cd460ef6a9d1bb WatchSource:0}: Error finding container ed4375a69776d7665b7c71c4ac7f6807fdcfae607ff3c5c635cd460ef6a9d1bb: Status 404 returned error can't find the container with id ed4375a69776d7665b7c71c4ac7f6807fdcfae607ff3c5c635cd460ef6a9d1bb
May 20 20:59:27.150955 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:27.150923    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5rvpr"]
May 20 20:59:27.151533 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:59:27.151509    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefea146b_019f_4a5d_883b_b38878513993.slice/crio-4de4df57fb1c98aab78298f13dc1a497b0649f8732731cd863aca628d8fdcbf1 WatchSource:0}: Error finding container 4de4df57fb1c98aab78298f13dc1a497b0649f8732731cd863aca628d8fdcbf1: Status 404 returned error can't find the container with id 4de4df57fb1c98aab78298f13dc1a497b0649f8732731cd863aca628d8fdcbf1
May 20 20:59:27.160563 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:27.160543    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b48d64b66-qtxkj"
May 20 20:59:27.293288 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:27.293255    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b48d64b66-qtxkj"]
May 20 20:59:27.293573 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:59:27.293551    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08a1ae0_b13b_442d_8e28_e056e98455e6.slice/crio-e2d527edd4f9add1409fcdb73746ea4198b0787e915c078cd34a03b9848b1709 WatchSource:0}: Error finding container e2d527edd4f9add1409fcdb73746ea4198b0787e915c078cd34a03b9848b1709: Status 404 returned error can't find the container with id e2d527edd4f9add1409fcdb73746ea4198b0787e915c078cd34a03b9848b1709
May 20 20:59:28.139522 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:28.139474    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-5rvpr" event={"ID":"efea146b-019f-4a5d-883b-b38878513993","Type":"ContainerStarted","Data":"4de4df57fb1c98aab78298f13dc1a497b0649f8732731cd863aca628d8fdcbf1"}
May 20 20:59:28.142815 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:28.142761    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b48d64b66-qtxkj" event={"ID":"e08a1ae0-b13b-442d-8e28-e056e98455e6","Type":"ContainerStarted","Data":"e2d527edd4f9add1409fcdb73746ea4198b0787e915c078cd34a03b9848b1709"}
May 20 20:59:28.145886 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:28.145853    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785f576c9c-qrwtt" event={"ID":"b447c653-7c5d-4240-8939-979fb4319694","Type":"ContainerStarted","Data":"ed4375a69776d7665b7c71c4ac7f6807fdcfae607ff3c5c635cd460ef6a9d1bb"}
May 20 20:59:32.166067 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.166024    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-5rvpr" event={"ID":"efea146b-019f-4a5d-883b-b38878513993","Type":"ContainerStarted","Data":"13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6"}
May 20 20:59:32.166583 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.166081    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fb5d86bc-5rvpr"
May 20 20:59:32.166583 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.166058    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-68fb5d86bc-5rvpr" podUID="efea146b-019f-4a5d-883b-b38878513993" containerName="manager" containerID="cri-o://13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6" gracePeriod=30
May 20 20:59:32.167845 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.167820    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b48d64b66-qtxkj" event={"ID":"e08a1ae0-b13b-442d-8e28-e056e98455e6","Type":"ContainerStarted","Data":"947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3"}
May 20 20:59:32.167991 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.167930    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b48d64b66-qtxkj"
May 20 20:59:32.169311 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.169286    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785f576c9c-qrwtt" event={"ID":"b447c653-7c5d-4240-8939-979fb4319694","Type":"ContainerStarted","Data":"12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab"}
May 20 20:59:32.169427 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.169382    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-785f576c9c-qrwtt"
May 20 20:59:32.188555 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.188516    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-68fb5d86bc-5rvpr" podStartSLOduration=2.053843532 podStartE2EDuration="6.188505418s" podCreationTimestamp="2026-05-20 20:59:26 +0000 UTC" firstStartedPulling="2026-05-20 20:59:27.152696747 +0000 UTC m=+640.082293467" lastFinishedPulling="2026-05-20 20:59:31.287358621 +0000 UTC m=+644.216955353" observedRunningTime="2026-05-20 20:59:32.185496719 +0000 UTC m=+645.115093459" watchObservedRunningTime="2026-05-20 20:59:32.188505418 +0000 UTC m=+645.118102157"
May 20 20:59:32.206914 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.206876    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7b48d64b66-qtxkj" podStartSLOduration=2.203399835 podStartE2EDuration="6.206864433s" podCreationTimestamp="2026-05-20 20:59:26 +0000 UTC" firstStartedPulling="2026-05-20 20:59:27.294980744 +0000 UTC m=+640.224577464" lastFinishedPulling="2026-05-20 20:59:31.298445339 +0000 UTC m=+644.228042062" observedRunningTime="2026-05-20 20:59:32.205143299 +0000 UTC m=+645.134740037" watchObservedRunningTime="2026-05-20 20:59:32.206864433 +0000 UTC m=+645.136461172"
May 20 20:59:32.228163 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.228124    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-785f576c9c-qrwtt" podStartSLOduration=2.072118282 podStartE2EDuration="6.228114707s" podCreationTimestamp="2026-05-20 20:59:26 +0000 UTC" firstStartedPulling="2026-05-20 20:59:27.131227276 +0000 UTC m=+640.060823993" lastFinishedPulling="2026-05-20 20:59:31.287223698 +0000 UTC m=+644.216820418" observedRunningTime="2026-05-20 20:59:32.225520432 +0000 UTC m=+645.155117171" watchObservedRunningTime="2026-05-20 20:59:32.228114707 +0000 UTC m=+645.157711442"
May 20 20:59:32.408223 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.408203    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-5rvpr"
May 20 20:59:32.440764 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.440704    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jj7p\" (UniqueName: \"kubernetes.io/projected/efea146b-019f-4a5d-883b-b38878513993-kube-api-access-6jj7p\") pod \"efea146b-019f-4a5d-883b-b38878513993\" (UID: \"efea146b-019f-4a5d-883b-b38878513993\") "
May 20 20:59:32.442717 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.442684    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efea146b-019f-4a5d-883b-b38878513993-kube-api-access-6jj7p" (OuterVolumeSpecName: "kube-api-access-6jj7p") pod "efea146b-019f-4a5d-883b-b38878513993" (UID: "efea146b-019f-4a5d-883b-b38878513993"). InnerVolumeSpecName "kube-api-access-6jj7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:59:32.541676 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:32.541644    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jj7p\" (UniqueName: \"kubernetes.io/projected/efea146b-019f-4a5d-883b-b38878513993-kube-api-access-6jj7p\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:59:33.175578 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:33.175537    2556 generic.go:358] "Generic (PLEG): container finished" podID="efea146b-019f-4a5d-883b-b38878513993" containerID="13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6" exitCode=0
May 20 20:59:33.176099 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:33.175609    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-5rvpr"
May 20 20:59:33.176099 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:33.175620    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-5rvpr" event={"ID":"efea146b-019f-4a5d-883b-b38878513993","Type":"ContainerDied","Data":"13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6"}
May 20 20:59:33.176099 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:33.175660    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-5rvpr" event={"ID":"efea146b-019f-4a5d-883b-b38878513993","Type":"ContainerDied","Data":"4de4df57fb1c98aab78298f13dc1a497b0649f8732731cd863aca628d8fdcbf1"}
May 20 20:59:33.176099 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:33.175674    2556 scope.go:117] "RemoveContainer" containerID="13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6"
May 20 20:59:33.192123 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:33.192103    2556 scope.go:117] "RemoveContainer" containerID="13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6"
May 20 20:59:33.192384 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:59:33.192367    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6\": container with ID starting with 13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6 not found: ID does not exist" containerID="13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6"
May 20 20:59:33.192501 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:33.192391    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6"} err="failed to get container status \"13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6\": rpc error: code = NotFound desc = could not find container \"13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6\": container with ID starting with 13cf65ed473aba1ca90dadf8d37a0e9a1721b01e5b9e9ebc898e92f56b50a6f6 not found: ID does not exist"
May 20 20:59:33.217215 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:33.217186    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5rvpr"]
May 20 20:59:33.222056 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:33.222035    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-5rvpr"]
May 20 20:59:33.675918 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:33.675886    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efea146b-019f-4a5d-883b-b38878513993" path="/var/lib/kubelet/pods/efea146b-019f-4a5d-883b-b38878513993/volumes"
May 20 20:59:43.183122 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.183081    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b48d64b66-qtxkj"
May 20 20:59:43.183549 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.183246    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-785f576c9c-qrwtt"
May 20 20:59:43.262835 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.262799    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-785f576c9c-qrwtt"]
May 20 20:59:43.263010 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.262990    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-785f576c9c-qrwtt" podUID="b447c653-7c5d-4240-8939-979fb4319694" containerName="manager" containerID="cri-o://12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab" gracePeriod=30
May 20 20:59:43.465152 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.465066    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d4467948-2q9kx"]
May 20 20:59:43.465613 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.465594    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efea146b-019f-4a5d-883b-b38878513993" containerName="manager"
May 20 20:59:43.465717 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.465615    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="efea146b-019f-4a5d-883b-b38878513993" containerName="manager"
May 20 20:59:43.465777 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.465718    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="efea146b-019f-4a5d-883b-b38878513993" containerName="manager"
May 20 20:59:43.469395 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.469370    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4467948-2q9kx"
May 20 20:59:43.481329 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.481303    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4467948-2q9kx"]
May 20 20:59:43.513964 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.513944    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785f576c9c-qrwtt"
May 20 20:59:43.530651 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.530626    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzjsj\" (UniqueName: \"kubernetes.io/projected/3c51efbf-c855-43a7-93d9-25e7f7737627-kube-api-access-mzjsj\") pod \"maas-controller-7d4467948-2q9kx\" (UID: \"3c51efbf-c855-43a7-93d9-25e7f7737627\") " pod="opendatahub/maas-controller-7d4467948-2q9kx"
May 20 20:59:43.632049 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.632016    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh8pv\" (UniqueName: \"kubernetes.io/projected/b447c653-7c5d-4240-8939-979fb4319694-kube-api-access-kh8pv\") pod \"b447c653-7c5d-4240-8939-979fb4319694\" (UID: \"b447c653-7c5d-4240-8939-979fb4319694\") "
May 20 20:59:43.632275 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.632258    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzjsj\" (UniqueName: \"kubernetes.io/projected/3c51efbf-c855-43a7-93d9-25e7f7737627-kube-api-access-mzjsj\") pod \"maas-controller-7d4467948-2q9kx\" (UID: \"3c51efbf-c855-43a7-93d9-25e7f7737627\") " pod="opendatahub/maas-controller-7d4467948-2q9kx"
May 20 20:59:43.634043 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.634021    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b447c653-7c5d-4240-8939-979fb4319694-kube-api-access-kh8pv" (OuterVolumeSpecName: "kube-api-access-kh8pv") pod "b447c653-7c5d-4240-8939-979fb4319694" (UID: "b447c653-7c5d-4240-8939-979fb4319694"). InnerVolumeSpecName "kube-api-access-kh8pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:59:43.642590 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.642568    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzjsj\" (UniqueName: \"kubernetes.io/projected/3c51efbf-c855-43a7-93d9-25e7f7737627-kube-api-access-mzjsj\") pod \"maas-controller-7d4467948-2q9kx\" (UID: \"3c51efbf-c855-43a7-93d9-25e7f7737627\") " pod="opendatahub/maas-controller-7d4467948-2q9kx"
May 20 20:59:43.733294 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.733234    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh8pv\" (UniqueName: \"kubernetes.io/projected/b447c653-7c5d-4240-8939-979fb4319694-kube-api-access-kh8pv\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:59:43.780244 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.780222    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4467948-2q9kx"
May 20 20:59:43.914335 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:43.914313    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4467948-2q9kx"]
May 20 20:59:43.916018 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:59:43.915991    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c51efbf_c855_43a7_93d9_25e7f7737627.slice/crio-34b54f4509b81ce3d22f7e25f27c2dbc334b33818d578add0831296852791d8a WatchSource:0}: Error finding container 34b54f4509b81ce3d22f7e25f27c2dbc334b33818d578add0831296852791d8a: Status 404 returned error can't find the container with id 34b54f4509b81ce3d22f7e25f27c2dbc334b33818d578add0831296852791d8a
May 20 20:59:44.223195 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:44.223149    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4467948-2q9kx" event={"ID":"3c51efbf-c855-43a7-93d9-25e7f7737627","Type":"ContainerStarted","Data":"34b54f4509b81ce3d22f7e25f27c2dbc334b33818d578add0831296852791d8a"}
May 20 20:59:44.224234 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:44.224209    2556 generic.go:358] "Generic (PLEG): container finished" podID="b447c653-7c5d-4240-8939-979fb4319694" containerID="12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab" exitCode=0
May 20 20:59:44.224341 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:44.224265    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785f576c9c-qrwtt" event={"ID":"b447c653-7c5d-4240-8939-979fb4319694","Type":"ContainerDied","Data":"12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab"}
May 20 20:59:44.224341 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:44.224300    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785f576c9c-qrwtt" event={"ID":"b447c653-7c5d-4240-8939-979fb4319694","Type":"ContainerDied","Data":"ed4375a69776d7665b7c71c4ac7f6807fdcfae607ff3c5c635cd460ef6a9d1bb"}
May 20 20:59:44.224341 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:44.224318    2556 scope.go:117] "RemoveContainer" containerID="12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab"
May 20 20:59:44.224461 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:44.224273    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785f576c9c-qrwtt"
May 20 20:59:44.233493 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:44.233466    2556 scope.go:117] "RemoveContainer" containerID="12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab"
May 20 20:59:44.233742 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:59:44.233723    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab\": container with ID starting with 12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab not found: ID does not exist" containerID="12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab"
May 20 20:59:44.233826 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:44.233749    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab"} err="failed to get container status \"12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab\": rpc error: code = NotFound desc = could not find container \"12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab\": container with ID starting with 12f0d5b6a3ab187f414ac3692e223035cae7878ed2e79b6b74993484e4cfd0ab not found: ID does not exist"
May 20 20:59:44.245869 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:44.245844    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-785f576c9c-qrwtt"]
May 20 20:59:44.250193 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:44.250171    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-785f576c9c-qrwtt"]
May 20 20:59:45.229369 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:45.229332    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4467948-2q9kx" event={"ID":"3c51efbf-c855-43a7-93d9-25e7f7737627","Type":"ContainerStarted","Data":"89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3"}
May 20 20:59:45.229835 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:45.229420    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d4467948-2q9kx"
May 20 20:59:45.261542 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:45.261498    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7d4467948-2q9kx" podStartSLOduration=1.9216918710000002 podStartE2EDuration="2.261485546s" podCreationTimestamp="2026-05-20 20:59:43 +0000 UTC" firstStartedPulling="2026-05-20 20:59:43.917278059 +0000 UTC m=+656.846874776" lastFinishedPulling="2026-05-20 20:59:44.25707173 +0000 UTC m=+657.186668451" observedRunningTime="2026-05-20 20:59:45.25552046 +0000 UTC m=+658.185117211" watchObservedRunningTime="2026-05-20 20:59:45.261485546 +0000 UTC m=+658.191082284"
May 20 20:59:45.675345 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:45.675310    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b447c653-7c5d-4240-8939-979fb4319694" path="/var/lib/kubelet/pods/b447c653-7c5d-4240-8939-979fb4319694/volumes"
May 20 20:59:52.581445 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.581392    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7cf9f4f6b6-dt885"]
May 20 20:59:52.581907 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.581892    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b447c653-7c5d-4240-8939-979fb4319694" containerName="manager"
May 20 20:59:52.581960 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.581909    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b447c653-7c5d-4240-8939-979fb4319694" containerName="manager"
May 20 20:59:52.581997 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.581984    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="b447c653-7c5d-4240-8939-979fb4319694" containerName="manager"
May 20 20:59:52.586405 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.586383    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 20:59:52.589468 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.589419    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 20 20:59:52.590159 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.590136    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8xsn5\""
May 20 20:59:52.603659 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.603632    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7cf9f4f6b6-dt885"]
May 20 20:59:52.717739 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.717709    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f683baf-3613-4f77-b334-05f23fa83b28-maas-api-tls\") pod \"maas-api-7cf9f4f6b6-dt885\" (UID: \"9f683baf-3613-4f77-b334-05f23fa83b28\") " pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 20:59:52.717916 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.717747    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkm6c\" (UniqueName: \"kubernetes.io/projected/9f683baf-3613-4f77-b334-05f23fa83b28-kube-api-access-dkm6c\") pod \"maas-api-7cf9f4f6b6-dt885\" (UID: \"9f683baf-3613-4f77-b334-05f23fa83b28\") " pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 20:59:52.818807 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.818772    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f683baf-3613-4f77-b334-05f23fa83b28-maas-api-tls\") pod \"maas-api-7cf9f4f6b6-dt885\" (UID: \"9f683baf-3613-4f77-b334-05f23fa83b28\") " pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 20:59:52.818807 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.818814    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkm6c\" (UniqueName: \"kubernetes.io/projected/9f683baf-3613-4f77-b334-05f23fa83b28-kube-api-access-dkm6c\") pod \"maas-api-7cf9f4f6b6-dt885\" (UID: \"9f683baf-3613-4f77-b334-05f23fa83b28\") " pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 20:59:52.821272 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.821248    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f683baf-3613-4f77-b334-05f23fa83b28-maas-api-tls\") pod \"maas-api-7cf9f4f6b6-dt885\" (UID: \"9f683baf-3613-4f77-b334-05f23fa83b28\") " pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 20:59:52.829162 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.829129    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkm6c\" (UniqueName: \"kubernetes.io/projected/9f683baf-3613-4f77-b334-05f23fa83b28-kube-api-access-dkm6c\") pod \"maas-api-7cf9f4f6b6-dt885\" (UID: \"9f683baf-3613-4f77-b334-05f23fa83b28\") " pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 20:59:52.896858 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:52.896829    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 20:59:53.038819 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:53.038790    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7cf9f4f6b6-dt885"]
May 20 20:59:53.039602 ip-10-0-142-248 kubenswrapper[2556]: W0520 20:59:53.039576    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f683baf_3613_4f77_b334_05f23fa83b28.slice/crio-0fee5f66262a149141be2c7499a206f9879f99c03bd21a6b6ab2f07b749d44f8 WatchSource:0}: Error finding container 0fee5f66262a149141be2c7499a206f9879f99c03bd21a6b6ab2f07b749d44f8: Status 404 returned error can't find the container with id 0fee5f66262a149141be2c7499a206f9879f99c03bd21a6b6ab2f07b749d44f8
May 20 20:59:53.262965 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:53.262890    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cf9f4f6b6-dt885" event={"ID":"9f683baf-3613-4f77-b334-05f23fa83b28","Type":"ContainerStarted","Data":"0fee5f66262a149141be2c7499a206f9879f99c03bd21a6b6ab2f07b749d44f8"}
May 20 20:59:55.288397 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:55.288363    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cf9f4f6b6-dt885" event={"ID":"9f683baf-3613-4f77-b334-05f23fa83b28","Type":"ContainerStarted","Data":"3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689"}
May 20 20:59:55.288791 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:55.288469    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 20:59:55.311640 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:55.311590    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-7cf9f4f6b6-dt885" podStartSLOduration=1.929835526 podStartE2EDuration="3.311577432s" podCreationTimestamp="2026-05-20 20:59:52 +0000 UTC" firstStartedPulling="2026-05-20 20:59:53.041000982 +0000 UTC m=+665.970597700" lastFinishedPulling="2026-05-20 20:59:54.422742889 +0000 UTC m=+667.352339606" observedRunningTime="2026-05-20 20:59:55.310678158 +0000 UTC m=+668.240274898" watchObservedRunningTime="2026-05-20 20:59:55.311577432 +0000 UTC m=+668.241174171"
May 20 20:59:56.241198 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:56.241163    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d4467948-2q9kx"
May 20 20:59:56.309248 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:56.309222    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b48d64b66-qtxkj"]
May 20 20:59:56.309649 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:56.309410    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7b48d64b66-qtxkj" podUID="e08a1ae0-b13b-442d-8e28-e056e98455e6" containerName="manager" containerID="cri-o://947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3" gracePeriod=30
May 20 20:59:56.557135 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:56.557109    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b48d64b66-qtxkj"
May 20 20:59:56.657343 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:56.657316    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhtmk\" (UniqueName: \"kubernetes.io/projected/e08a1ae0-b13b-442d-8e28-e056e98455e6-kube-api-access-jhtmk\") pod \"e08a1ae0-b13b-442d-8e28-e056e98455e6\" (UID: \"e08a1ae0-b13b-442d-8e28-e056e98455e6\") "
May 20 20:59:56.659330 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:56.659296    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e08a1ae0-b13b-442d-8e28-e056e98455e6-kube-api-access-jhtmk" (OuterVolumeSpecName: "kube-api-access-jhtmk") pod "e08a1ae0-b13b-442d-8e28-e056e98455e6" (UID: "e08a1ae0-b13b-442d-8e28-e056e98455e6"). InnerVolumeSpecName "kube-api-access-jhtmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:59:56.758149 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:56.758118    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhtmk\" (UniqueName: \"kubernetes.io/projected/e08a1ae0-b13b-442d-8e28-e056e98455e6-kube-api-access-jhtmk\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 20:59:57.298403 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:57.298363    2556 generic.go:358] "Generic (PLEG): container finished" podID="e08a1ae0-b13b-442d-8e28-e056e98455e6" containerID="947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3" exitCode=0
May 20 20:59:57.298601 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:57.298449    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b48d64b66-qtxkj"
May 20 20:59:57.298601 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:57.298472    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b48d64b66-qtxkj" event={"ID":"e08a1ae0-b13b-442d-8e28-e056e98455e6","Type":"ContainerDied","Data":"947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3"}
May 20 20:59:57.298601 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:57.298519    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b48d64b66-qtxkj" event={"ID":"e08a1ae0-b13b-442d-8e28-e056e98455e6","Type":"ContainerDied","Data":"e2d527edd4f9add1409fcdb73746ea4198b0787e915c078cd34a03b9848b1709"}
May 20 20:59:57.298601 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:57.298540    2556 scope.go:117] "RemoveContainer" containerID="947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3"
May 20 20:59:57.308060 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:57.308039    2556 scope.go:117] "RemoveContainer" containerID="947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3"
May 20 20:59:57.308311 ip-10-0-142-248 kubenswrapper[2556]: E0520 20:59:57.308291    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3\": container with ID starting with 947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3 not found: ID does not exist" containerID="947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3"
May 20 20:59:57.308380 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:57.308322    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3"} err="failed to get container status \"947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3\": rpc error: code = NotFound desc = could not find container \"947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3\": container with ID starting with 947b86670af44300e9d4ff57900580498410c123dd2046c55a0a8d7a1df153c3 not found: ID does not exist"
May 20 20:59:57.326409 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:57.326375    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b48d64b66-qtxkj"]
May 20 20:59:57.331214 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:57.331190    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b48d64b66-qtxkj"]
May 20 20:59:57.675918 ip-10-0-142-248 kubenswrapper[2556]: I0520 20:59:57.675884    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e08a1ae0-b13b-442d-8e28-e056e98455e6" path="/var/lib/kubelet/pods/e08a1ae0-b13b-442d-8e28-e056e98455e6/volumes"
May 20 21:00:01.298444 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:01.298400    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 21:00:03.239625 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:03.239593    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:00:03.240044 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:03.239811    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak" containerID="cri-o://49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e" gracePeriod=30
May 20 21:00:05.295579 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.295556    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 21:00:05.334865 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.334829    2556 generic.go:358] "Generic (PLEG): container finished" podID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerID="49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e" exitCode=143
May 20 21:00:05.335053 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.334903    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 21:00:05.335053 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.334918    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c1dc008d-db14-4548-aa97-b80aa365cd40","Type":"ContainerDied","Data":"49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e"}
May 20 21:00:05.335053 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.334952    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c1dc008d-db14-4548-aa97-b80aa365cd40","Type":"ContainerDied","Data":"f14c634bd1f5e0ed0cf406cc652c15fd2b1a2768fcfc634a88dd4cba05d4f0eb"}
May 20 21:00:05.335053 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.334971    2556 scope.go:117] "RemoveContainer" containerID="49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e"
May 20 21:00:05.344963 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.344942    2556 scope.go:117] "RemoveContainer" containerID="49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e"
May 20 21:00:05.345255 ip-10-0-142-248 kubenswrapper[2556]: E0520 21:00:05.345221    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e\": container with ID starting with 49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e not found: ID does not exist" containerID="49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e"
May 20 21:00:05.345314 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.345255    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e"} err="failed to get container status \"49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e\": rpc error: code = NotFound desc = could not find container \"49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e\": container with ID starting with 49016a4119e235536af7f57c2b810235aaba47ced2a63104aa148fd927293d7e not found: ID does not exist"
May 20 21:00:05.436472 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.436363    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcjj6\" (UniqueName: \"kubernetes.io/projected/c1dc008d-db14-4548-aa97-b80aa365cd40-kube-api-access-bcjj6\") pod \"c1dc008d-db14-4548-aa97-b80aa365cd40\" (UID: \"c1dc008d-db14-4548-aa97-b80aa365cd40\") "
May 20 21:00:05.438602 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.438577    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1dc008d-db14-4548-aa97-b80aa365cd40-kube-api-access-bcjj6" (OuterVolumeSpecName: "kube-api-access-bcjj6") pod "c1dc008d-db14-4548-aa97-b80aa365cd40" (UID: "c1dc008d-db14-4548-aa97-b80aa365cd40"). InnerVolumeSpecName "kube-api-access-bcjj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:00:05.537428 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.537395    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcjj6\" (UniqueName: \"kubernetes.io/projected/c1dc008d-db14-4548-aa97-b80aa365cd40-kube-api-access-bcjj6\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:00:05.662418 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.662349    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:00:05.665253 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.665224    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:00:05.676036 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.676005    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" path="/var/lib/kubelet/pods/c1dc008d-db14-4548-aa97-b80aa365cd40/volumes"
May 20 21:00:05.695759 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.695686    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:00:05.696162 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.696144    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak"
May 20 21:00:05.696242 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.696163    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak"
May 20 21:00:05.696242 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.696182    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e08a1ae0-b13b-442d-8e28-e056e98455e6" containerName="manager"
May 20 21:00:05.696242 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.696188    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e08a1ae0-b13b-442d-8e28-e056e98455e6" containerName="manager"
May 20 21:00:05.696346 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.696256    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1dc008d-db14-4548-aa97-b80aa365cd40" containerName="keycloak"
May 20 21:00:05.696346 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.696267    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="e08a1ae0-b13b-442d-8e28-e056e98455e6" containerName="manager"
May 20 21:00:05.699513 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.699495    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 21:00:05.702316 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.702293    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-kxnff\""
May 20 21:00:05.702442 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.702322    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 20 21:00:05.702442 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.702324    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
May 20 21:00:05.702644 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.702629    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
May 20 21:00:05.702714 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.702699    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 20 21:00:05.712110 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.712088    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:00:05.839840 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.839802    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-test-realms\") pod \"maas-keycloak-0\" (UID: \"e0f03ee8-c391-4a4a-8f72-eb388d4418e1\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:00:05.839840 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.839841    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdftg\" (UniqueName: \"kubernetes.io/projected/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-kube-api-access-cdftg\") pod \"maas-keycloak-0\" (UID: \"e0f03ee8-c391-4a4a-8f72-eb388d4418e1\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:00:05.940869 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.940822    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-test-realms\") pod \"maas-keycloak-0\" (UID: \"e0f03ee8-c391-4a4a-8f72-eb388d4418e1\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:00:05.940869 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.940876    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdftg\" (UniqueName: \"kubernetes.io/projected/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-kube-api-access-cdftg\") pod \"maas-keycloak-0\" (UID: \"e0f03ee8-c391-4a4a-8f72-eb388d4418e1\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:00:05.941557 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.941537    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-test-realms\") pod \"maas-keycloak-0\" (UID: \"e0f03ee8-c391-4a4a-8f72-eb388d4418e1\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:00:05.950626 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:05.950582    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdftg\" (UniqueName: \"kubernetes.io/projected/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-kube-api-access-cdftg\") pod \"maas-keycloak-0\" (UID: \"e0f03ee8-c391-4a4a-8f72-eb388d4418e1\") " pod="keycloak-system/maas-keycloak-0"
May 20 21:00:06.008940 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:06.008901    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 21:00:06.140069 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:06.139931    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:00:06.142349 ip-10-0-142-248 kubenswrapper[2556]: W0520 21:00:06.142320    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f03ee8_c391_4a4a_8f72_eb388d4418e1.slice/crio-a3661886258ba5bc58e430a4f49b8b9b9e3b5328dcb976a1c747dc5ac6de1fab WatchSource:0}: Error finding container a3661886258ba5bc58e430a4f49b8b9b9e3b5328dcb976a1c747dc5ac6de1fab: Status 404 returned error can't find the container with id a3661886258ba5bc58e430a4f49b8b9b9e3b5328dcb976a1c747dc5ac6de1fab
May 20 21:00:06.341140 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:06.341072    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e0f03ee8-c391-4a4a-8f72-eb388d4418e1","Type":"ContainerStarted","Data":"a3661886258ba5bc58e430a4f49b8b9b9e3b5328dcb976a1c747dc5ac6de1fab"}
May 20 21:00:07.350242 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:07.350194    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e0f03ee8-c391-4a4a-8f72-eb388d4418e1","Type":"ContainerStarted","Data":"d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d"}
May 20 21:00:07.380544 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:07.380471    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.963638588 podStartE2EDuration="2.380451384s" podCreationTimestamp="2026-05-20 21:00:05 +0000 UTC" firstStartedPulling="2026-05-20 21:00:06.143850222 +0000 UTC m=+679.073446938" lastFinishedPulling="2026-05-20 21:00:06.560663002 +0000 UTC m=+679.490259734" observedRunningTime="2026-05-20 21:00:07.375127034 +0000 UTC m=+680.304723774" watchObservedRunningTime="2026-05-20 21:00:07.380451384 +0000 UTC m=+680.310048126"
May 20 21:00:08.009720 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:08.009676    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
May 20 21:00:08.011535 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:08.011481    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:09.009841 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:09.009793    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:10.009456 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:10.009389    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:11.009977 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:11.009926    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:12.009568 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:12.009524    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:13.009924 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:13.009868    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:14.010569 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:14.010097    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:15.010314 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:15.010267    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:16.009326 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:16.009278    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
May 20 21:00:16.009780 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:16.009611    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:17.009481 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:17.009408    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:18.009512 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:18.009457    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:19.010019 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:19.009967    2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.55:9000/health/started\": dial tcp 10.134.0.55:9000: connect: connection refused"
May 20 21:00:20.110629 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:20.110580    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
May 20 21:00:20.126250 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:20.126131    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 21:00:23.900349 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:23.900317    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-7cf9f4f6b6-dt885"]
May 20 21:00:23.901027 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:23.900646    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7cf9f4f6b6-dt885" podUID="9f683baf-3613-4f77-b334-05f23fa83b28" containerName="maas-api" containerID="cri-o://3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689" gracePeriod=30
May 20 21:00:24.168923 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.168897    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 21:00:24.228022 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.227988    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkm6c\" (UniqueName: \"kubernetes.io/projected/9f683baf-3613-4f77-b334-05f23fa83b28-kube-api-access-dkm6c\") pod \"9f683baf-3613-4f77-b334-05f23fa83b28\" (UID: \"9f683baf-3613-4f77-b334-05f23fa83b28\") "
May 20 21:00:24.228301 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.228279    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f683baf-3613-4f77-b334-05f23fa83b28-maas-api-tls\") pod \"9f683baf-3613-4f77-b334-05f23fa83b28\" (UID: \"9f683baf-3613-4f77-b334-05f23fa83b28\") "
May 20 21:00:24.230867 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.230813    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f683baf-3613-4f77-b334-05f23fa83b28-kube-api-access-dkm6c" (OuterVolumeSpecName: "kube-api-access-dkm6c") pod "9f683baf-3613-4f77-b334-05f23fa83b28" (UID: "9f683baf-3613-4f77-b334-05f23fa83b28"). InnerVolumeSpecName "kube-api-access-dkm6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:00:24.230977 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.230916    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f683baf-3613-4f77-b334-05f23fa83b28-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9f683baf-3613-4f77-b334-05f23fa83b28" (UID: "9f683baf-3613-4f77-b334-05f23fa83b28"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 21:00:24.329840 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.329793    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkm6c\" (UniqueName: \"kubernetes.io/projected/9f683baf-3613-4f77-b334-05f23fa83b28-kube-api-access-dkm6c\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:00:24.329840 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.329835    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f683baf-3613-4f77-b334-05f23fa83b28-maas-api-tls\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:00:24.455868 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.455761    2556 generic.go:358] "Generic (PLEG): container finished" podID="9f683baf-3613-4f77-b334-05f23fa83b28" containerID="3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689" exitCode=0
May 20 21:00:24.455868 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.455840    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7cf9f4f6b6-dt885"
May 20 21:00:24.456122 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.455957    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cf9f4f6b6-dt885" event={"ID":"9f683baf-3613-4f77-b334-05f23fa83b28","Type":"ContainerDied","Data":"3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689"}
May 20 21:00:24.456122 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.455985    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7cf9f4f6b6-dt885" event={"ID":"9f683baf-3613-4f77-b334-05f23fa83b28","Type":"ContainerDied","Data":"0fee5f66262a149141be2c7499a206f9879f99c03bd21a6b6ab2f07b749d44f8"}
May 20 21:00:24.456122 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.456004    2556 scope.go:117] "RemoveContainer" containerID="3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689"
May 20 21:00:24.469951 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.469933    2556 scope.go:117] "RemoveContainer" containerID="3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689"
May 20 21:00:24.470344 ip-10-0-142-248 kubenswrapper[2556]: E0520 21:00:24.470320    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689\": container with ID starting with 3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689 not found: ID does not exist" containerID="3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689"
May 20 21:00:24.470542 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.470516    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689"} err="failed to get container status \"3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689\": rpc error: code = NotFound desc = could not find container \"3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689\": container with ID starting with 3665c12d2f39666601da0ea1f6ac475d48b124745c16069527c826848e0a2689 not found: ID does not exist"
May 20 21:00:24.485191 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.485162    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-7cf9f4f6b6-dt885"]
May 20 21:00:24.497452 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:24.496421    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-7cf9f4f6b6-dt885"]
May 20 21:00:25.678126 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:25.678086    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f683baf-3613-4f77-b334-05f23fa83b28" path="/var/lib/kubelet/pods/9f683baf-3613-4f77-b334-05f23fa83b28/volumes"
May 20 21:00:30.117426 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:30.117392    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
May 20 21:00:40.892758 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.892667    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6fcc8df944-8kbm5"]
May 20 21:00:40.893292 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.893271    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f683baf-3613-4f77-b334-05f23fa83b28" containerName="maas-api"
May 20 21:00:40.893380 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.893294    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f683baf-3613-4f77-b334-05f23fa83b28" containerName="maas-api"
May 20 21:00:40.893476 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.893419    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f683baf-3613-4f77-b334-05f23fa83b28" containerName="maas-api"
May 20 21:00:40.896318 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.896296    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:00:40.899213 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.899194    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 20 21:00:40.900046 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.900029    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5mcs2\""
May 20 21:00:40.900118 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.900065    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\""
May 20 21:00:40.905802 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.905779    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fcc8df944-8kbm5"]
May 20 21:00:40.994866 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.994829    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-tls-cert\") pod \"authorino-6fcc8df944-8kbm5\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") " pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:00:40.994866 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.994869    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-oidc-ca\") pod \"authorino-6fcc8df944-8kbm5\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") " pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:00:40.995064 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:40.994893    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvlxt\" (UniqueName: \"kubernetes.io/projected/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-kube-api-access-lvlxt\") pod \"authorino-6fcc8df944-8kbm5\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") " pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:00:41.095681 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:41.095648    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-tls-cert\") pod \"authorino-6fcc8df944-8kbm5\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") " pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:00:41.095681 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:41.095683    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-oidc-ca\") pod \"authorino-6fcc8df944-8kbm5\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") " pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:00:41.095925 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:41.095817    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvlxt\" (UniqueName: \"kubernetes.io/projected/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-kube-api-access-lvlxt\") pod \"authorino-6fcc8df944-8kbm5\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") " pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:00:41.096474 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:41.096428    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-oidc-ca\") pod \"authorino-6fcc8df944-8kbm5\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") " pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:00:41.098176 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:41.098154    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-tls-cert\") pod \"authorino-6fcc8df944-8kbm5\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") " pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:00:41.113535 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:41.113513    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvlxt\" (UniqueName: \"kubernetes.io/projected/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-kube-api-access-lvlxt\") pod \"authorino-6fcc8df944-8kbm5\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") " pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:00:41.208221 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:41.208128    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:00:41.342413 ip-10-0-142-248 kubenswrapper[2556]: W0520 21:00:41.342382    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31ed0986_c8ad_4c54_ad1f_e1ab8bdb7afb.slice/crio-3e323dd75237e0c7a6fc3c4cdd1de3c9b7f36bf6cad0041574ae7a86645340bb WatchSource:0}: Error finding container 3e323dd75237e0c7a6fc3c4cdd1de3c9b7f36bf6cad0041574ae7a86645340bb: Status 404 returned error can't find the container with id 3e323dd75237e0c7a6fc3c4cdd1de3c9b7f36bf6cad0041574ae7a86645340bb
May 20 21:00:41.343247 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:41.343218    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fcc8df944-8kbm5"]
May 20 21:00:41.527334 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:41.527242    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fcc8df944-8kbm5" event={"ID":"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb","Type":"ContainerStarted","Data":"3e323dd75237e0c7a6fc3c4cdd1de3c9b7f36bf6cad0041574ae7a86645340bb"}
May 20 21:00:42.532686 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:42.532644    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fcc8df944-8kbm5" event={"ID":"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb","Type":"ContainerStarted","Data":"878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9"}
May 20 21:00:42.554523 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:42.554468    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6fcc8df944-8kbm5" podStartSLOduration=2.160068488 podStartE2EDuration="2.554424004s" podCreationTimestamp="2026-05-20 21:00:40 +0000 UTC" firstStartedPulling="2026-05-20 21:00:41.34381114 +0000 UTC m=+714.273407858" lastFinishedPulling="2026-05-20 21:00:41.738166654 +0000 UTC m=+714.667763374" observedRunningTime="2026-05-20 21:00:42.551087824 +0000 UTC m=+715.480684562" watchObservedRunningTime="2026-05-20 21:00:42.554424004 +0000 UTC m=+715.484020778"
May 20 21:00:58.337306 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.337271    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"]
May 20 21:00:58.342344 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.342326    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.349826 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.349792    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 20 21:00:58.349947 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.349826    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 20 21:00:58.349947 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.349826    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j2z8q\""
May 20 21:00:58.349947 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.349887    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 20 21:00:58.363668 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.363646    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"]
May 20 21:00:58.447213 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.447186    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.447340 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.447238    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.447340 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.447261    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.447460 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.447355    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.447460 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.447399    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcqls\" (UniqueName: \"kubernetes.io/projected/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-kube-api-access-zcqls\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.447460 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.447419    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.548740 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.548713    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.548860 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.548743    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.548860 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.548783    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.548860 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.548812    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqls\" (UniqueName: \"kubernetes.io/projected/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-kube-api-access-zcqls\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.548860 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.548829    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.549050 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.548872    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.549185 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.549162    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.549185 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.549176    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.549308 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.549229    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.551109 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.551088    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.551375 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.551359    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.565307 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.565278    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcqls\" (UniqueName: \"kubernetes.io/projected/ff3774ee-c85d-4d13-aca3-c67db7dfe5c1-kube-api-access-zcqls\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-tkskz\" (UID: \"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.652584 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.652560    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:00:58.784159 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:58.784132    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"]
May 20 21:00:58.785694 ip-10-0-142-248 kubenswrapper[2556]: W0520 21:00:58.785664    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3774ee_c85d_4d13_aca3_c67db7dfe5c1.slice/crio-80d52d8c1b33259ff5a93ccec23548d204d2978b1e534dd260990f30ffbb83a3 WatchSource:0}: Error finding container 80d52d8c1b33259ff5a93ccec23548d204d2978b1e534dd260990f30ffbb83a3: Status 404 returned error can't find the container with id 80d52d8c1b33259ff5a93ccec23548d204d2978b1e534dd260990f30ffbb83a3
May 20 21:00:59.606154 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:00:59.606119    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz" event={"ID":"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1","Type":"ContainerStarted","Data":"80d52d8c1b33259ff5a93ccec23548d204d2978b1e534dd260990f30ffbb83a3"}
May 20 21:01:05.633163 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:05.633120    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz" event={"ID":"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1","Type":"ContainerStarted","Data":"0e45735d28fb10602d5b18af5f826b6f17dfe3d0107f54e79999f9c0ff981440"}
May 20 21:01:10.654107 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:10.654065    2556 generic.go:358] "Generic (PLEG): container finished" podID="ff3774ee-c85d-4d13-aca3-c67db7dfe5c1" containerID="0e45735d28fb10602d5b18af5f826b6f17dfe3d0107f54e79999f9c0ff981440" exitCode=0
May 20 21:01:10.654596 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:10.654139    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz" event={"ID":"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1","Type":"ContainerDied","Data":"0e45735d28fb10602d5b18af5f826b6f17dfe3d0107f54e79999f9c0ff981440"}
May 20 21:01:12.667712 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:12.667668    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz" event={"ID":"ff3774ee-c85d-4d13-aca3-c67db7dfe5c1","Type":"ContainerStarted","Data":"6c582aafb1a15cb9ed88bd85700aef55cb8313516507c79ea62d0cd23b5e2c74"}
May 20 21:01:12.668105 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:12.667896    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:01:12.697847 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:12.697796    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz" podStartSLOduration=1.44915145 podStartE2EDuration="14.697780815s" podCreationTimestamp="2026-05-20 21:00:58 +0000 UTC" firstStartedPulling="2026-05-20 21:00:58.78737065 +0000 UTC m=+731.716967367" lastFinishedPulling="2026-05-20 21:01:12.036000008 +0000 UTC m=+744.965596732" observedRunningTime="2026-05-20 21:01:12.693905165 +0000 UTC m=+745.623501903" watchObservedRunningTime="2026-05-20 21:01:12.697780815 +0000 UTC m=+745.627377553"
May 20 21:01:23.692834 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:23.692806    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-tkskz"
May 20 21:01:25.789023 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.788992    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"]
May 20 21:01:25.813242 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.813206    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"]
May 20 21:01:25.813392 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.813343    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:25.816629 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.816603    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 20 21:01:25.900806 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.900775    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:25.900960 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.900821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ec9021c-e535-4d20-a4b5-217e198a7eb2-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:25.900960 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.900924    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:25.901069 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.900964    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:25.901069 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.901011    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:25.901069 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.901048    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrmr6\" (UniqueName: \"kubernetes.io/projected/1ec9021c-e535-4d20-a4b5-217e198a7eb2-kube-api-access-xrmr6\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:25.995157 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.995126    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"]
May 20 21:01:25.998111 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:25.998094    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.000902 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.000883    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 20 21:01:26.001570 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.001551    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrmr6\" (UniqueName: \"kubernetes.io/projected/1ec9021c-e535-4d20-a4b5-217e198a7eb2-kube-api-access-xrmr6\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.001626 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.001592    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.001665 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.001649    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ec9021c-e535-4d20-a4b5-217e198a7eb2-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.001735 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.001721    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.001785 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.001752    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.001823 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.001792    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.002105 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.002078    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.002216 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.002163    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.002283 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.002236    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.004177 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.004145    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ec9021c-e535-4d20-a4b5-217e198a7eb2-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.004413 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.004394    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ec9021c-e535-4d20-a4b5-217e198a7eb2-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.009239 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.009214    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"]
May 20 21:01:26.014126 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.014099    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrmr6\" (UniqueName: \"kubernetes.io/projected/1ec9021c-e535-4d20-a4b5-217e198a7eb2-kube-api-access-xrmr6\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c\" (UID: \"1ec9021c-e535-4d20-a4b5-217e198a7eb2\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.102863 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.102802    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.102863 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.102846    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.103018 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.102944    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64f89\" (UniqueName: \"kubernetes.io/projected/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-kube-api-access-64f89\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.103018 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.102993    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.103100 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.103064    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.103153 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.103131    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.124490 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.124455    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:26.204288 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.204260    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.204488 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.204303    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.204488 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.204345    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64f89\" (UniqueName: \"kubernetes.io/projected/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-kube-api-access-64f89\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.204488 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.204367    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.204488 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.204391    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.204488 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.204424    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.204774 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.204715    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.204827 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.204788    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.205019 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.204997    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.206801 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.206776    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.207410 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.207209    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.213983 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.213958    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64f89\" (UniqueName: \"kubernetes.io/projected/5355c6bf-65c0-42ab-93a5-7a8b039bb19f-kube-api-access-64f89\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl\" (UID: \"5355c6bf-65c0-42ab-93a5-7a8b039bb19f\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.264718 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.264693    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"]
May 20 21:01:26.265717 ip-10-0-142-248 kubenswrapper[2556]: W0520 21:01:26.265689    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec9021c_e535_4d20_a4b5_217e198a7eb2.slice/crio-54b237d7136f97e77f1c3a1ca03c4435b4abe4c06d55d3dc420ee8f0fb0d9ee4 WatchSource:0}: Error finding container 54b237d7136f97e77f1c3a1ca03c4435b4abe4c06d55d3dc420ee8f0fb0d9ee4: Status 404 returned error can't find the container with id 54b237d7136f97e77f1c3a1ca03c4435b4abe4c06d55d3dc420ee8f0fb0d9ee4
May 20 21:01:26.329021 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.328998    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:26.465888 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.465850    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"]
May 20 21:01:26.467194 ip-10-0-142-248 kubenswrapper[2556]: W0520 21:01:26.467166    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5355c6bf_65c0_42ab_93a5_7a8b039bb19f.slice/crio-a947f127c9631202a10e586abc8a2b681a29dc6401503b10b4b9f39b68a2c51a WatchSource:0}: Error finding container a947f127c9631202a10e586abc8a2b681a29dc6401503b10b4b9f39b68a2c51a: Status 404 returned error can't find the container with id a947f127c9631202a10e586abc8a2b681a29dc6401503b10b4b9f39b68a2c51a
May 20 21:01:26.722976 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.722939    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl" event={"ID":"5355c6bf-65c0-42ab-93a5-7a8b039bb19f","Type":"ContainerStarted","Data":"f7560f027a1b81983c93a225498d08d2270b1ec43da5f5263713562756ef66b0"}
May 20 21:01:26.722976 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.722980    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl" event={"ID":"5355c6bf-65c0-42ab-93a5-7a8b039bb19f","Type":"ContainerStarted","Data":"a947f127c9631202a10e586abc8a2b681a29dc6401503b10b4b9f39b68a2c51a"}
May 20 21:01:26.724482 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.724427    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c" event={"ID":"1ec9021c-e535-4d20-a4b5-217e198a7eb2","Type":"ContainerStarted","Data":"d91e965b371ce97b47a4eccdad5e0935fc8e853389595984f189eeb89032bcdb"}
May 20 21:01:26.724482 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:26.724483    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c" event={"ID":"1ec9021c-e535-4d20-a4b5-217e198a7eb2","Type":"ContainerStarted","Data":"54b237d7136f97e77f1c3a1ca03c4435b4abe4c06d55d3dc420ee8f0fb0d9ee4"}
May 20 21:01:31.747707 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:31.747676    2556 generic.go:358] "Generic (PLEG): container finished" podID="1ec9021c-e535-4d20-a4b5-217e198a7eb2" containerID="d91e965b371ce97b47a4eccdad5e0935fc8e853389595984f189eeb89032bcdb" exitCode=0
May 20 21:01:31.748067 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:31.747750    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c" event={"ID":"1ec9021c-e535-4d20-a4b5-217e198a7eb2","Type":"ContainerDied","Data":"d91e965b371ce97b47a4eccdad5e0935fc8e853389595984f189eeb89032bcdb"}
May 20 21:01:32.753691 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:32.753654    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c" event={"ID":"1ec9021c-e535-4d20-a4b5-217e198a7eb2","Type":"ContainerStarted","Data":"1bab0daedb82bb9b8419f9230471a05aac8cd867e736bc1f2f3fbf29728fd6a3"}
May 20 21:01:32.754123 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:32.753876    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:32.755055 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:32.755032    2556 generic.go:358] "Generic (PLEG): container finished" podID="5355c6bf-65c0-42ab-93a5-7a8b039bb19f" containerID="f7560f027a1b81983c93a225498d08d2270b1ec43da5f5263713562756ef66b0" exitCode=0
May 20 21:01:32.755168 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:32.755100    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl" event={"ID":"5355c6bf-65c0-42ab-93a5-7a8b039bb19f","Type":"ContainerDied","Data":"f7560f027a1b81983c93a225498d08d2270b1ec43da5f5263713562756ef66b0"}
May 20 21:01:32.780646 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:32.780609    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c" podStartSLOduration=7.490348412 podStartE2EDuration="7.780596236s" podCreationTimestamp="2026-05-20 21:01:25 +0000 UTC" firstStartedPulling="2026-05-20 21:01:31.748398162 +0000 UTC m=+764.677994879" lastFinishedPulling="2026-05-20 21:01:32.038645982 +0000 UTC m=+764.968242703" observedRunningTime="2026-05-20 21:01:32.777683565 +0000 UTC m=+765.707280304" watchObservedRunningTime="2026-05-20 21:01:32.780596236 +0000 UTC m=+765.710192975"
May 20 21:01:33.766000 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:33.765962    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl" event={"ID":"5355c6bf-65c0-42ab-93a5-7a8b039bb19f","Type":"ContainerStarted","Data":"5cac4f50a512b3dce29d5a8972dca71484532967efab457c8f58f2423a960767"}
May 20 21:01:33.766450 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:33.766339    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:01:33.793419 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:33.793370    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl" podStartSLOduration=8.205899532 podStartE2EDuration="8.793357196s" podCreationTimestamp="2026-05-20 21:01:25 +0000 UTC" firstStartedPulling="2026-05-20 21:01:32.755702899 +0000 UTC m=+765.685299616" lastFinishedPulling="2026-05-20 21:01:33.343160558 +0000 UTC m=+766.272757280" observedRunningTime="2026-05-20 21:01:33.791850236 +0000 UTC m=+766.721446997" watchObservedRunningTime="2026-05-20 21:01:33.793357196 +0000 UTC m=+766.722953934"
May 20 21:01:43.778908 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:43.778875    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c"
May 20 21:01:44.784219 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:01:44.784190    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl"
May 20 21:02:37.003828 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.003791    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fcc8df944-8kbm5"]
May 20 21:02:37.004722 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.004008    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-6fcc8df944-8kbm5" podUID="31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb" containerName="authorino" containerID="cri-o://878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9" gracePeriod=30
May 20 21:02:37.267113 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.267047    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:02:37.362174 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.362146    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvlxt\" (UniqueName: \"kubernetes.io/projected/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-kube-api-access-lvlxt\") pod \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") "
May 20 21:02:37.362357 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.362211    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-tls-cert\") pod \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") "
May 20 21:02:37.362357 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.362252    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-oidc-ca\") pod \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\" (UID: \"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb\") "
May 20 21:02:37.364282 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.364239    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-kube-api-access-lvlxt" (OuterVolumeSpecName: "kube-api-access-lvlxt") pod "31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb" (UID: "31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb"). InnerVolumeSpecName "kube-api-access-lvlxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:02:37.367632 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.367600    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb" (UID: "31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 21:02:37.372750 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.372725    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb" (UID: "31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 21:02:37.463601 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.463567    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvlxt\" (UniqueName: \"kubernetes.io/projected/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-kube-api-access-lvlxt\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:02:37.463601 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.463596    2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-tls-cert\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:02:37.463601 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:37.463606    2556 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb-oidc-ca\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:02:38.031178 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:38.031083    2556 generic.go:358] "Generic (PLEG): container finished" podID="31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb" containerID="878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9" exitCode=0
May 20 21:02:38.031178 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:38.031152    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fcc8df944-8kbm5"
May 20 21:02:38.031759 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:38.031175    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fcc8df944-8kbm5" event={"ID":"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb","Type":"ContainerDied","Data":"878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9"}
May 20 21:02:38.031759 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:38.031220    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fcc8df944-8kbm5" event={"ID":"31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb","Type":"ContainerDied","Data":"3e323dd75237e0c7a6fc3c4cdd1de3c9b7f36bf6cad0041574ae7a86645340bb"}
May 20 21:02:38.031759 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:38.031241    2556 scope.go:117] "RemoveContainer" containerID="878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9"
May 20 21:02:38.040711 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:38.040695    2556 scope.go:117] "RemoveContainer" containerID="878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9"
May 20 21:02:38.040964 ip-10-0-142-248 kubenswrapper[2556]: E0520 21:02:38.040945    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9\": container with ID starting with 878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9 not found: ID does not exist" containerID="878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9"
May 20 21:02:38.041013 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:38.040972    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9"} err="failed to get container status \"878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9\": rpc error: code = NotFound desc = could not find container \"878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9\": container with ID starting with 878ca62a6ed7a6f72a6f3b9a630a39bcfa7285edc734245c2ab3c0e9f2d491d9 not found: ID does not exist"
May 20 21:02:38.054528 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:38.054502    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6fcc8df944-8kbm5"]
May 20 21:02:38.062921 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:38.062901    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6fcc8df944-8kbm5"]
May 20 21:02:39.675227 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:39.675191    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb" path="/var/lib/kubelet/pods/31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb/volumes"
May 20 21:02:43.114781 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.114749    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"]
May 20 21:02:43.115201 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.115186    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb" containerName="authorino"
May 20 21:02:43.115247 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.115203    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb" containerName="authorino"
May 20 21:02:43.115288 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.115279    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="31ed0986-c8ad-4c54-ad1f-e1ab8bdb7afb" containerName="authorino"
May 20 21:02:43.118027 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.118010    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:43.121939 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.121913    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-84cqs\""
May 20 21:02:43.121939 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.121925    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 21:02:43.122420 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.122404    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 21:02:43.129769 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.129748    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"]
May 20 21:02:43.215418 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.215387    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzxhl\" (UniqueName: \"kubernetes.io/projected/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-kube-api-access-nzxhl\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:43.215582 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.215456    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:43.215582 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.215513    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:43.316570 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.316540    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:43.316713 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.316618    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzxhl\" (UniqueName: \"kubernetes.io/projected/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-kube-api-access-nzxhl\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:43.316713 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.316643    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:43.316895 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.316875    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:43.316972 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.316937    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:43.329310 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.329292    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzxhl\" (UniqueName: \"kubernetes.io/projected/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-kube-api-access-nzxhl\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:43.427999 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.427979    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:43.563137 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:43.563111    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"]
May 20 21:02:43.564385 ip-10-0-142-248 kubenswrapper[2556]: W0520 21:02:43.564356    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9cb0e5_53a7_4216_980f_e12a0cf802ae.slice/crio-ff02d37d974533318bd775ca13265c67df37713a3907c2f9608ada1b465d61d4 WatchSource:0}: Error finding container ff02d37d974533318bd775ca13265c67df37713a3907c2f9608ada1b465d61d4: Status 404 returned error can't find the container with id ff02d37d974533318bd775ca13265c67df37713a3907c2f9608ada1b465d61d4
May 20 21:02:44.056004 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:44.055968    2556 generic.go:358] "Generic (PLEG): container finished" podID="fa9cb0e5-53a7-4216-980f-e12a0cf802ae" containerID="20e6a3d2aabebb1c6ac3fa24ac2b6f475ed3835adf29acddbf22865c7d04fd47" exitCode=0
May 20 21:02:44.056199 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:44.056064    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw" event={"ID":"fa9cb0e5-53a7-4216-980f-e12a0cf802ae","Type":"ContainerDied","Data":"20e6a3d2aabebb1c6ac3fa24ac2b6f475ed3835adf29acddbf22865c7d04fd47"}
May 20 21:02:44.056199 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:44.056104    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw" event={"ID":"fa9cb0e5-53a7-4216-980f-e12a0cf802ae","Type":"ContainerStarted","Data":"ff02d37d974533318bd775ca13265c67df37713a3907c2f9608ada1b465d61d4"}
May 20 21:02:45.061802 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:45.061765    2556 generic.go:358] "Generic (PLEG): container finished" podID="fa9cb0e5-53a7-4216-980f-e12a0cf802ae" containerID="de1a457eb04299b6623263d6e58de37c5908ae7555e1f3239bddd310c7688962" exitCode=0
May 20 21:02:45.062189 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:45.061847    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw" event={"ID":"fa9cb0e5-53a7-4216-980f-e12a0cf802ae","Type":"ContainerDied","Data":"de1a457eb04299b6623263d6e58de37c5908ae7555e1f3239bddd310c7688962"}
May 20 21:02:46.067718 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:46.067685    2556 generic.go:358] "Generic (PLEG): container finished" podID="fa9cb0e5-53a7-4216-980f-e12a0cf802ae" containerID="2ddce5d53385df387a9c57c3839a02a1a644c5da42c54dc23dc9994fb2bfa858" exitCode=0
May 20 21:02:46.068118 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:46.067770    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw" event={"ID":"fa9cb0e5-53a7-4216-980f-e12a0cf802ae","Type":"ContainerDied","Data":"2ddce5d53385df387a9c57c3839a02a1a644c5da42c54dc23dc9994fb2bfa858"}
May 20 21:02:47.195755 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:47.195730    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:47.254450 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:47.254411    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzxhl\" (UniqueName: \"kubernetes.io/projected/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-kube-api-access-nzxhl\") pod \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") "
May 20 21:02:47.254644 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:47.254494    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-util\") pod \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") "
May 20 21:02:47.254644 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:47.254570    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-bundle\") pod \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\" (UID: \"fa9cb0e5-53a7-4216-980f-e12a0cf802ae\") "
May 20 21:02:47.255337 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:47.255305    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-bundle" (OuterVolumeSpecName: "bundle") pod "fa9cb0e5-53a7-4216-980f-e12a0cf802ae" (UID: "fa9cb0e5-53a7-4216-980f-e12a0cf802ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 21:02:47.256802 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:47.256767    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-kube-api-access-nzxhl" (OuterVolumeSpecName: "kube-api-access-nzxhl") pod "fa9cb0e5-53a7-4216-980f-e12a0cf802ae" (UID: "fa9cb0e5-53a7-4216-980f-e12a0cf802ae"). InnerVolumeSpecName "kube-api-access-nzxhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:02:47.264274 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:47.264248    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-util" (OuterVolumeSpecName: "util") pod "fa9cb0e5-53a7-4216-980f-e12a0cf802ae" (UID: "fa9cb0e5-53a7-4216-980f-e12a0cf802ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 21:02:47.355915 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:47.355851    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzxhl\" (UniqueName: \"kubernetes.io/projected/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-kube-api-access-nzxhl\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:02:47.355915 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:47.355874    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-util\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:02:47.355915 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:47.355884    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa9cb0e5-53a7-4216-980f-e12a0cf802ae-bundle\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:02:48.078068 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:48.077986    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw"
May 20 21:02:48.078068 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:48.078005    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70d88bw" event={"ID":"fa9cb0e5-53a7-4216-980f-e12a0cf802ae","Type":"ContainerDied","Data":"ff02d37d974533318bd775ca13265c67df37713a3907c2f9608ada1b465d61d4"}
May 20 21:02:48.078068 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:02:48.078038    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff02d37d974533318bd775ca13265c67df37713a3907c2f9608ada1b465d61d4"
May 20 21:03:12.289442 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:12.289394    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:03:12.289938 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:12.289626    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak" containerID="cri-o://d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d" gracePeriod=30
May 20 21:03:13.937738 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:13.937712    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 21:03:14.101566 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.101468    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdftg\" (UniqueName: \"kubernetes.io/projected/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-kube-api-access-cdftg\") pod \"e0f03ee8-c391-4a4a-8f72-eb388d4418e1\" (UID: \"e0f03ee8-c391-4a4a-8f72-eb388d4418e1\") "
May 20 21:03:14.101566 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.101524    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-test-realms\") pod \"e0f03ee8-c391-4a4a-8f72-eb388d4418e1\" (UID: \"e0f03ee8-c391-4a4a-8f72-eb388d4418e1\") "
May 20 21:03:14.101900 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.101870    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-test-realms" (OuterVolumeSpecName: "test-realms") pod "e0f03ee8-c391-4a4a-8f72-eb388d4418e1" (UID: "e0f03ee8-c391-4a4a-8f72-eb388d4418e1"). InnerVolumeSpecName "test-realms". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 21:03:14.103544 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.103513    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-kube-api-access-cdftg" (OuterVolumeSpecName: "kube-api-access-cdftg") pod "e0f03ee8-c391-4a4a-8f72-eb388d4418e1" (UID: "e0f03ee8-c391-4a4a-8f72-eb388d4418e1"). InnerVolumeSpecName "kube-api-access-cdftg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:03:14.193306 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.193275    2556 generic.go:358] "Generic (PLEG): container finished" podID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerID="d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d" exitCode=143
May 20 21:03:14.193460 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.193369    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 21:03:14.193460 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.193362    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e0f03ee8-c391-4a4a-8f72-eb388d4418e1","Type":"ContainerDied","Data":"d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d"}
May 20 21:03:14.193542 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.193480    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e0f03ee8-c391-4a4a-8f72-eb388d4418e1","Type":"ContainerDied","Data":"a3661886258ba5bc58e430a4f49b8b9b9e3b5328dcb976a1c747dc5ac6de1fab"}
May 20 21:03:14.193542 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.193500    2556 scope.go:117] "RemoveContainer" containerID="d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d"
May 20 21:03:14.202766 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.202745    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdftg\" (UniqueName: \"kubernetes.io/projected/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-kube-api-access-cdftg\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:03:14.202843 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.202769    2556 reconciler_common.go:299] "Volume detached for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e0f03ee8-c391-4a4a-8f72-eb388d4418e1-test-realms\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:03:14.203584 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.203572    2556 scope.go:117] "RemoveContainer" containerID="d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d"
May 20 21:03:14.203808 ip-10-0-142-248 kubenswrapper[2556]: E0520 21:03:14.203791    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d\": container with ID starting with d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d not found: ID does not exist" containerID="d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d"
May 20 21:03:14.203857 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.203814    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d"} err="failed to get container status \"d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d\": rpc error: code = NotFound desc = could not find container \"d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d\": container with ID starting with d0c548d79ad948371405b15018dd4d5394429b82b60ee9ac377bb6e9e04de83d not found: ID does not exist"
May 20 21:03:14.217694 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.217671    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:03:14.221904 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:14.221882    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 21:03:15.675833 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:03:15.675798    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" path="/var/lib/kubelet/pods/e0f03ee8-c391-4a4a-8f72-eb388d4418e1/volumes"
May 20 21:04:05.804923 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:05.804886    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d4467948-2q9kx"]
May 20 21:04:05.805446 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:05.805137    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7d4467948-2q9kx" podUID="3c51efbf-c855-43a7-93d9-25e7f7737627" containerName="manager" containerID="cri-o://89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3" gracePeriod=30
May 20 21:04:06.050196 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.050170    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4467948-2q9kx"
May 20 21:04:06.065040 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.064978    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzjsj\" (UniqueName: \"kubernetes.io/projected/3c51efbf-c855-43a7-93d9-25e7f7737627-kube-api-access-mzjsj\") pod \"3c51efbf-c855-43a7-93d9-25e7f7737627\" (UID: \"3c51efbf-c855-43a7-93d9-25e7f7737627\") "
May 20 21:04:06.067101 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.067064    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c51efbf-c855-43a7-93d9-25e7f7737627-kube-api-access-mzjsj" (OuterVolumeSpecName: "kube-api-access-mzjsj") pod "3c51efbf-c855-43a7-93d9-25e7f7737627" (UID: "3c51efbf-c855-43a7-93d9-25e7f7737627"). InnerVolumeSpecName "kube-api-access-mzjsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:04:06.166279 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.166252    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzjsj\" (UniqueName: \"kubernetes.io/projected/3c51efbf-c855-43a7-93d9-25e7f7737627-kube-api-access-mzjsj\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:04:06.406859 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.406824    2556 generic.go:358] "Generic (PLEG): container finished" podID="3c51efbf-c855-43a7-93d9-25e7f7737627" containerID="89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3" exitCode=0
May 20 21:04:06.407046 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.406877    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4467948-2q9kx"
May 20 21:04:06.407046 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.406897    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4467948-2q9kx" event={"ID":"3c51efbf-c855-43a7-93d9-25e7f7737627","Type":"ContainerDied","Data":"89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3"}
May 20 21:04:06.407046 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.406934    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4467948-2q9kx" event={"ID":"3c51efbf-c855-43a7-93d9-25e7f7737627","Type":"ContainerDied","Data":"34b54f4509b81ce3d22f7e25f27c2dbc334b33818d578add0831296852791d8a"}
May 20 21:04:06.407046 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.406948    2556 scope.go:117] "RemoveContainer" containerID="89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3"
May 20 21:04:06.416812 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.416794    2556 scope.go:117] "RemoveContainer" containerID="89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3"
May 20 21:04:06.417056 ip-10-0-142-248 kubenswrapper[2556]: E0520 21:04:06.417038    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3\": container with ID starting with 89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3 not found: ID does not exist" containerID="89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3"
May 20 21:04:06.417116 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.417068    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3"} err="failed to get container status \"89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3\": rpc error: code = NotFound desc = could not find container \"89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3\": container with ID starting with 89c381f197a5615c3006d33dd51f959c0356e400d0ad7bf0b2620b5a9b07ffc3 not found: ID does not exist"
May 20 21:04:06.430938 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.430916    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d4467948-2q9kx"]
May 20 21:04:06.439864 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:06.439103    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d4467948-2q9kx"]
May 20 21:04:07.193932 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.193894    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d4467948-86wvj"]
May 20 21:04:07.194395 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194378    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9cb0e5-53a7-4216-980f-e12a0cf802ae" containerName="pull"
May 20 21:04:07.194469 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194399    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9cb0e5-53a7-4216-980f-e12a0cf802ae" containerName="pull"
May 20 21:04:07.194469 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194409    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9cb0e5-53a7-4216-980f-e12a0cf802ae" containerName="util"
May 20 21:04:07.194469 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194414    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9cb0e5-53a7-4216-980f-e12a0cf802ae" containerName="util"
May 20 21:04:07.194469 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194451    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c51efbf-c855-43a7-93d9-25e7f7737627" containerName="manager"
May 20 21:04:07.194469 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194458    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c51efbf-c855-43a7-93d9-25e7f7737627" containerName="manager"
May 20 21:04:07.194635 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194473    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak"
May 20 21:04:07.194635 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194478    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak"
May 20 21:04:07.194635 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194486    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9cb0e5-53a7-4216-980f-e12a0cf802ae" containerName="extract"
May 20 21:04:07.194635 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194494    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9cb0e5-53a7-4216-980f-e12a0cf802ae" containerName="extract"
May 20 21:04:07.194635 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194558    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0f03ee8-c391-4a4a-8f72-eb388d4418e1" containerName="keycloak"
May 20 21:04:07.194635 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194565    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c51efbf-c855-43a7-93d9-25e7f7737627" containerName="manager"
May 20 21:04:07.194635 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.194574    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa9cb0e5-53a7-4216-980f-e12a0cf802ae" containerName="extract"
May 20 21:04:07.197381 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.197364    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4467948-86wvj"
May 20 21:04:07.199690 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.199666    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 20 21:04:07.199811 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.199673    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tnwns\""
May 20 21:04:07.207984 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.207958    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4467948-86wvj"]
May 20 21:04:07.277244 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.277213    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhzmg\" (UniqueName: \"kubernetes.io/projected/919f8cd3-47b0-4c50-8226-fd7f6bc8d2a6-kube-api-access-dhzmg\") pod \"maas-controller-7d4467948-86wvj\" (UID: \"919f8cd3-47b0-4c50-8226-fd7f6bc8d2a6\") " pod="opendatahub/maas-controller-7d4467948-86wvj"
May 20 21:04:07.378622 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.378588    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhzmg\" (UniqueName: \"kubernetes.io/projected/919f8cd3-47b0-4c50-8226-fd7f6bc8d2a6-kube-api-access-dhzmg\") pod \"maas-controller-7d4467948-86wvj\" (UID: \"919f8cd3-47b0-4c50-8226-fd7f6bc8d2a6\") " pod="opendatahub/maas-controller-7d4467948-86wvj"
May 20 21:04:07.388072 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.388044    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhzmg\" (UniqueName: \"kubernetes.io/projected/919f8cd3-47b0-4c50-8226-fd7f6bc8d2a6-kube-api-access-dhzmg\") pod \"maas-controller-7d4467948-86wvj\" (UID: \"919f8cd3-47b0-4c50-8226-fd7f6bc8d2a6\") " pod="opendatahub/maas-controller-7d4467948-86wvj"
May 20 21:04:07.508474 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.508376    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4467948-86wvj"
May 20 21:04:07.676671 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.676639    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c51efbf-c855-43a7-93d9-25e7f7737627" path="/var/lib/kubelet/pods/3c51efbf-c855-43a7-93d9-25e7f7737627/volumes"
May 20 21:04:07.857598 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:07.857571    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4467948-86wvj"]
May 20 21:04:07.859285 ip-10-0-142-248 kubenswrapper[2556]: W0520 21:04:07.859254    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919f8cd3_47b0_4c50_8226_fd7f6bc8d2a6.slice/crio-80cbeb1dfc2db8f955bd6b5e60c91f6e3c1081a52f0abb6230a101ae2e3b385d WatchSource:0}: Error finding container 80cbeb1dfc2db8f955bd6b5e60c91f6e3c1081a52f0abb6230a101ae2e3b385d: Status 404 returned error can't find the container with id 80cbeb1dfc2db8f955bd6b5e60c91f6e3c1081a52f0abb6230a101ae2e3b385d
May 20 21:04:08.418464 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:08.418411    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4467948-86wvj" event={"ID":"919f8cd3-47b0-4c50-8226-fd7f6bc8d2a6","Type":"ContainerStarted","Data":"32ef164aa1c065fc53bb66a458dfd394232a16f54c52f75bd1c283efae393930"}
May 20 21:04:08.418464 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:08.418463    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4467948-86wvj" event={"ID":"919f8cd3-47b0-4c50-8226-fd7f6bc8d2a6","Type":"ContainerStarted","Data":"80cbeb1dfc2db8f955bd6b5e60c91f6e3c1081a52f0abb6230a101ae2e3b385d"}
May 20 21:04:08.418978 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:08.418564    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d4467948-86wvj"
May 20 21:04:08.436647 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:08.436601    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7d4467948-86wvj" podStartSLOduration=0.985599541 podStartE2EDuration="1.436588316s" podCreationTimestamp="2026-05-20 21:04:07 +0000 UTC" firstStartedPulling="2026-05-20 21:04:07.860587722 +0000 UTC m=+920.790184439" lastFinishedPulling="2026-05-20 21:04:08.311576482 +0000 UTC m=+921.241173214" observedRunningTime="2026-05-20 21:04:08.434927678 +0000 UTC m=+921.364524429" watchObservedRunningTime="2026-05-20 21:04:08.436588316 +0000 UTC m=+921.366185054"
May 20 21:04:19.430080 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:04:19.430048    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d4467948-86wvj"
May 20 21:15:00.145705 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:00.145675    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29655195-x5ttq"]
May 20 21:15:00.149045 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:00.149029    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655195-x5ttq"
May 20 21:15:00.151421 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:00.151402    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8xsn5\""
May 20 21:15:00.157664 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:00.157641    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655195-x5ttq"]
May 20 21:15:00.197039 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:00.197012    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhrn6\" (UniqueName: \"kubernetes.io/projected/d1cefcf0-0559-4a2e-9e54-db90840bb2be-kube-api-access-fhrn6\") pod \"maas-api-key-cleanup-29655195-x5ttq\" (UID: \"d1cefcf0-0559-4a2e-9e54-db90840bb2be\") " pod="opendatahub/maas-api-key-cleanup-29655195-x5ttq"
May 20 21:15:00.298333 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:00.298307    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhrn6\" (UniqueName: \"kubernetes.io/projected/d1cefcf0-0559-4a2e-9e54-db90840bb2be-kube-api-access-fhrn6\") pod \"maas-api-key-cleanup-29655195-x5ttq\" (UID: \"d1cefcf0-0559-4a2e-9e54-db90840bb2be\") " pod="opendatahub/maas-api-key-cleanup-29655195-x5ttq"
May 20 21:15:00.308252 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:00.308229    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhrn6\" (UniqueName: \"kubernetes.io/projected/d1cefcf0-0559-4a2e-9e54-db90840bb2be-kube-api-access-fhrn6\") pod \"maas-api-key-cleanup-29655195-x5ttq\" (UID: \"d1cefcf0-0559-4a2e-9e54-db90840bb2be\") " pod="opendatahub/maas-api-key-cleanup-29655195-x5ttq"
May 20 21:15:00.460584 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:00.460497    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655195-x5ttq"
May 20 21:15:00.592757 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:00.592730    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655195-x5ttq"]
May 20 21:15:00.594303 ip-10-0-142-248 kubenswrapper[2556]: W0520 21:15:00.594277    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1cefcf0_0559_4a2e_9e54_db90840bb2be.slice/crio-55fb01c1209f6a37695956b9ce771eb960b9834034f5b008db26d3ea94ae08fe WatchSource:0}: Error finding container 55fb01c1209f6a37695956b9ce771eb960b9834034f5b008db26d3ea94ae08fe: Status 404 returned error can't find the container with id 55fb01c1209f6a37695956b9ce771eb960b9834034f5b008db26d3ea94ae08fe
May 20 21:15:00.595943 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:00.595928    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 21:15:01.103799 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:01.103766    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655195-x5ttq" event={"ID":"d1cefcf0-0559-4a2e-9e54-db90840bb2be","Type":"ContainerStarted","Data":"55fb01c1209f6a37695956b9ce771eb960b9834034f5b008db26d3ea94ae08fe"}
May 20 21:15:04.117208 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:04.117119    2556 generic.go:358] "Generic (PLEG): container finished" podID="d1cefcf0-0559-4a2e-9e54-db90840bb2be" containerID="bb03aeb5130cdbaada3dfea6473dbcb14c9887d85e99f84ad5a57a3c6a480066" exitCode=0
May 20 21:15:04.117581 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:04.117205    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655195-x5ttq" event={"ID":"d1cefcf0-0559-4a2e-9e54-db90840bb2be","Type":"ContainerDied","Data":"bb03aeb5130cdbaada3dfea6473dbcb14c9887d85e99f84ad5a57a3c6a480066"}
May 20 21:15:05.250622 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:05.250601    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655195-x5ttq"
May 20 21:15:05.344510 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:05.344471    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhrn6\" (UniqueName: \"kubernetes.io/projected/d1cefcf0-0559-4a2e-9e54-db90840bb2be-kube-api-access-fhrn6\") pod \"d1cefcf0-0559-4a2e-9e54-db90840bb2be\" (UID: \"d1cefcf0-0559-4a2e-9e54-db90840bb2be\") "
May 20 21:15:05.346510 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:05.346478    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1cefcf0-0559-4a2e-9e54-db90840bb2be-kube-api-access-fhrn6" (OuterVolumeSpecName: "kube-api-access-fhrn6") pod "d1cefcf0-0559-4a2e-9e54-db90840bb2be" (UID: "d1cefcf0-0559-4a2e-9e54-db90840bb2be"). InnerVolumeSpecName "kube-api-access-fhrn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:15:05.446099 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:05.446064    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhrn6\" (UniqueName: \"kubernetes.io/projected/d1cefcf0-0559-4a2e-9e54-db90840bb2be-kube-api-access-fhrn6\") on node \"ip-10-0-142-248.ec2.internal\" DevicePath \"\""
May 20 21:15:06.126863 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:06.126828    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655195-x5ttq" event={"ID":"d1cefcf0-0559-4a2e-9e54-db90840bb2be","Type":"ContainerDied","Data":"55fb01c1209f6a37695956b9ce771eb960b9834034f5b008db26d3ea94ae08fe"}
May 20 21:15:06.127071 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:06.126867    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55fb01c1209f6a37695956b9ce771eb960b9834034f5b008db26d3ea94ae08fe"
May 20 21:15:06.127071 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:15:06.126844    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655195-x5ttq"
May 20 21:25:19.978120 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:19.978091    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655195-x5ttq_d1cefcf0-0559-4a2e-9e54-db90840bb2be/cleanup/0.log"
May 20 21:25:20.098678 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:20.098649    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d4467948-86wvj_919f8cd3-47b0-4c50-8226-fd7f6bc8d2a6/manager/0.log"
May 20 21:25:20.340875 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:20.340791    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d5db49587-6mwxx_ee799f6b-6177-4a2d-86e2-6fc02d325435/manager/0.log"
May 20 21:25:21.454151 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.454114    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg_9c431124-6627-43bd-a145-97d52389a4ad/util/0.log"
May 20 21:25:21.460670 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.460643    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg_9c431124-6627-43bd-a145-97d52389a4ad/pull/0.log"
May 20 21:25:21.466702 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.466672    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg_9c431124-6627-43bd-a145-97d52389a4ad/extract/0.log"
May 20 21:25:21.571892 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.571868    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq_e2d024ad-7352-4302-8049-dab5660b72ff/util/0.log"
May 20 21:25:21.578564 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.578543    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq_e2d024ad-7352-4302-8049-dab5660b72ff/pull/0.log"
May 20 21:25:21.584709 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.584691    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq_e2d024ad-7352-4302-8049-dab5660b72ff/extract/0.log"
May 20 21:25:21.695917 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.695896    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2_28c96318-bb41-4972-9367-d7ce621effe0/util/0.log"
May 20 21:25:21.702157 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.702136    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2_28c96318-bb41-4972-9367-d7ce621effe0/pull/0.log"
May 20 21:25:21.709234 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.709178    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2_28c96318-bb41-4972-9367-d7ce621effe0/extract/0.log"
May 20 21:25:21.817682 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.817660    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx_cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc/util/0.log"
May 20 21:25:21.824405 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.824382    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx_cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc/pull/0.log"
May 20 21:25:21.830768 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:21.830749    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx_cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc/extract/0.log"
May 20 21:25:22.077264 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:22.077176    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-295cb_e2994bd0-8a00-4e19-8dca-63bc18359548/manager/0.log"
May 20 21:25:22.188825 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:22.188774    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-2lqth_daab3063-72ac-441c-8dea-24ea1958c7f1/manager/0.log"
May 20 21:25:22.773462 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:22.773408    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-pf8xs_b74e5e8d-aa64-4da7-a008-6921481987cd/manager/0.log"
May 20 21:25:23.110488 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:23.110387    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj_c763f752-5529-4473-8c0d-c8834f1a14ff/istio-proxy/0.log"
May 20 21:25:23.565745 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:23.565715    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-2hw6v_e9b3607d-c1b2-49ec-adae-dcf1005c67d2/istio-proxy/0.log"
May 20 21:25:23.796519 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:23.796491    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bd77c4d94-5l8ck_f4402bc2-97c9-4867-8e96-4938d325a1fa/router/0.log"
May 20 21:25:24.251678 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:24.251648    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c_1ec9021c-e535-4d20-a4b5-217e198a7eb2/storage-initializer/0.log"
May 20 21:25:24.259667 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:24.259639    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-5sl4c_1ec9021c-e535-4d20-a4b5-217e198a7eb2/main/0.log"
May 20 21:25:24.373726 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:24.373700    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-tkskz_ff3774ee-c85d-4d13-aca3-c67db7dfe5c1/storage-initializer/0.log"
May 20 21:25:24.381855 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:24.381835    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-tkskz_ff3774ee-c85d-4d13-aca3-c67db7dfe5c1/main/0.log"
May 20 21:25:24.607680 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:24.607595    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl_5355c6bf-65c0-42ab-93a5-7a8b039bb19f/storage-initializer/0.log"
May 20 21:25:24.615566 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:24.615536    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-dzshl_5355c6bf-65c0-42ab-93a5-7a8b039bb19f/main/0.log"
May 20 21:25:28.947163 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:28.947127    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s85mv/must-gather-cvwrt"]
May 20 21:25:28.947643 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:28.947619    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1cefcf0-0559-4a2e-9e54-db90840bb2be" containerName="cleanup"
May 20 21:25:28.947643 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:28.947633    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1cefcf0-0559-4a2e-9e54-db90840bb2be" containerName="cleanup"
May 20 21:25:28.947721 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:28.947713    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="d1cefcf0-0559-4a2e-9e54-db90840bb2be" containerName="cleanup"
May 20 21:25:28.950996 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:28.950974    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s85mv/must-gather-cvwrt"
May 20 21:25:28.955083 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:28.955063    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s85mv\"/\"openshift-service-ca.crt\""
May 20 21:25:28.955083 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:28.955077    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s85mv\"/\"kube-root-ca.crt\""
May 20 21:25:28.955219 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:28.955078    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s85mv\"/\"default-dockercfg-srg7g\""
May 20 21:25:28.969897 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:28.969872    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s85mv/must-gather-cvwrt"]
May 20 21:25:29.037444 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:29.037394    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqjn9\" (UniqueName: \"kubernetes.io/projected/0f73c1ec-ffeb-4987-8f70-b6a72539416f-kube-api-access-kqjn9\") pod \"must-gather-cvwrt\" (UID: \"0f73c1ec-ffeb-4987-8f70-b6a72539416f\") " pod="openshift-must-gather-s85mv/must-gather-cvwrt"
May 20 21:25:29.037637 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:29.037589    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0f73c1ec-ffeb-4987-8f70-b6a72539416f-must-gather-output\") pod \"must-gather-cvwrt\" (UID: \"0f73c1ec-ffeb-4987-8f70-b6a72539416f\") " pod="openshift-must-gather-s85mv/must-gather-cvwrt"
May 20 21:25:29.139021 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:29.138977    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0f73c1ec-ffeb-4987-8f70-b6a72539416f-must-gather-output\") pod \"must-gather-cvwrt\" (UID: \"0f73c1ec-ffeb-4987-8f70-b6a72539416f\") " pod="openshift-must-gather-s85mv/must-gather-cvwrt"
May 20 21:25:29.139207 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:29.139075    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqjn9\" (UniqueName: \"kubernetes.io/projected/0f73c1ec-ffeb-4987-8f70-b6a72539416f-kube-api-access-kqjn9\") pod \"must-gather-cvwrt\" (UID: \"0f73c1ec-ffeb-4987-8f70-b6a72539416f\") " pod="openshift-must-gather-s85mv/must-gather-cvwrt"
May 20 21:25:29.139328 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:29.139306    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0f73c1ec-ffeb-4987-8f70-b6a72539416f-must-gather-output\") pod \"must-gather-cvwrt\" (UID: \"0f73c1ec-ffeb-4987-8f70-b6a72539416f\") " pod="openshift-must-gather-s85mv/must-gather-cvwrt"
May 20 21:25:29.147646 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:29.147619    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqjn9\" (UniqueName: \"kubernetes.io/projected/0f73c1ec-ffeb-4987-8f70-b6a72539416f-kube-api-access-kqjn9\") pod \"must-gather-cvwrt\" (UID: \"0f73c1ec-ffeb-4987-8f70-b6a72539416f\") " pod="openshift-must-gather-s85mv/must-gather-cvwrt"
May 20 21:25:29.261049 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:29.260969    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s85mv/must-gather-cvwrt"
May 20 21:25:29.395573 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:29.395543    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s85mv/must-gather-cvwrt"]
May 20 21:25:29.396536 ip-10-0-142-248 kubenswrapper[2556]: W0520 21:25:29.396510    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f73c1ec_ffeb_4987_8f70_b6a72539416f.slice/crio-bbbe5b5e8f8c32fc79488094a032f14ba981dd9a54930e65a9c6081c69f248f0 WatchSource:0}: Error finding container bbbe5b5e8f8c32fc79488094a032f14ba981dd9a54930e65a9c6081c69f248f0: Status 404 returned error can't find the container with id bbbe5b5e8f8c32fc79488094a032f14ba981dd9a54930e65a9c6081c69f248f0
May 20 21:25:29.398400 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:29.398381    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 21:25:29.674734 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:29.674698    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s85mv/must-gather-cvwrt" event={"ID":"0f73c1ec-ffeb-4987-8f70-b6a72539416f","Type":"ContainerStarted","Data":"bbbe5b5e8f8c32fc79488094a032f14ba981dd9a54930e65a9c6081c69f248f0"}
May 20 21:25:30.679505 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:30.679467    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s85mv/must-gather-cvwrt" event={"ID":"0f73c1ec-ffeb-4987-8f70-b6a72539416f","Type":"ContainerStarted","Data":"f8b9f2cb40083beb2086e5450c37cc8247553187174efca759fc38d47923644f"}
May 20 21:25:30.679505 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:30.679511    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s85mv/must-gather-cvwrt" event={"ID":"0f73c1ec-ffeb-4987-8f70-b6a72539416f","Type":"ContainerStarted","Data":"a5f69912596c292a774b7ceed195f84d12bb15a789af3a832b10df8578c0b3ad"}
May 20 21:25:30.698606 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:30.698546    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-s85mv/must-gather-cvwrt" podStartSLOduration=1.910288928 podStartE2EDuration="2.698528134s" podCreationTimestamp="2026-05-20 21:25:28 +0000 UTC" firstStartedPulling="2026-05-20 21:25:29.398595812 +0000 UTC m=+2202.328192543" lastFinishedPulling="2026-05-20 21:25:30.186835023 +0000 UTC m=+2203.116431749" observedRunningTime="2026-05-20 21:25:30.6962018 +0000 UTC m=+2203.625798540" watchObservedRunningTime="2026-05-20 21:25:30.698528134 +0000 UTC m=+2203.628124874"
May 20 21:25:31.949060 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:31.948973    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s8r5d_e790382a-2ad5-40e0-82e1-ed7df94e4d0e/global-pull-secret-syncer/0.log"
May 20 21:25:32.045299 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:32.045269    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hngnv_77d15cbb-b7fe-476a-9281-d65587fc0b99/konnectivity-agent/0.log"
May 20 21:25:32.196521 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:32.196489    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-248.ec2.internal_720b70deb7ab5afafdb209777059a35b/haproxy/0.log"
May 20 21:25:36.052162 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.052003    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg_9c431124-6627-43bd-a145-97d52389a4ad/extract/0.log"
May 20 21:25:36.079960 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.079921    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg_9c431124-6627-43bd-a145-97d52389a4ad/util/0.log"
May 20 21:25:36.106355 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.106319    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tsjgg_9c431124-6627-43bd-a145-97d52389a4ad/pull/0.log"
May 20 21:25:36.137550 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.137504    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq_e2d024ad-7352-4302-8049-dab5660b72ff/extract/0.log"
May 20 21:25:36.164387 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.164355    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq_e2d024ad-7352-4302-8049-dab5660b72ff/util/0.log"
May 20 21:25:36.188955 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.188918    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0j67sq_e2d024ad-7352-4302-8049-dab5660b72ff/pull/0.log"
May 20 21:25:36.218449 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.218404    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2_28c96318-bb41-4972-9367-d7ce621effe0/extract/0.log"
May 20 21:25:36.240144 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.240105    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2_28c96318-bb41-4972-9367-d7ce621effe0/util/0.log"
May 20 21:25:36.264157 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.264095    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vxtd2_28c96318-bb41-4972-9367-d7ce621effe0/pull/0.log"
May 20 21:25:36.294491 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.294460    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx_cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc/extract/0.log"
May 20 21:25:36.316673 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.316573    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx_cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc/util/0.log"
May 20 21:25:36.346527 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.346495    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w2zqx_cc10bf7e-37f4-4393-ad3d-74ea9a5c8bfc/pull/0.log"
May 20 21:25:36.740672 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.740638    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-295cb_e2994bd0-8a00-4e19-8dca-63bc18359548/manager/0.log"
May 20 21:25:36.763775 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:36.763739    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-2lqth_daab3063-72ac-441c-8dea-24ea1958c7f1/manager/0.log"
May 20 21:25:37.036035 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:37.035952    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-pf8xs_b74e5e8d-aa64-4da7-a008-6921481987cd/manager/0.log"
May 20 21:25:38.506034 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:38.506003    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a77f409-fc3a-4c87-9aca-0f3b17750292/alertmanager/0.log"
May 20 21:25:38.534203 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:38.534177    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a77f409-fc3a-4c87-9aca-0f3b17750292/config-reloader/0.log"
May 20 21:25:38.557886 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:38.557860    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a77f409-fc3a-4c87-9aca-0f3b17750292/kube-rbac-proxy-web/0.log"
May 20 21:25:38.587119 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:38.587071    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a77f409-fc3a-4c87-9aca-0f3b17750292/kube-rbac-proxy/0.log"
May 20 21:25:38.611768 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:38.611737    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a77f409-fc3a-4c87-9aca-0f3b17750292/kube-rbac-proxy-metric/0.log"
May 20 21:25:38.634111 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:38.634086    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a77f409-fc3a-4c87-9aca-0f3b17750292/prom-label-proxy/0.log"
May 20 21:25:38.657834 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:38.657748    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5a77f409-fc3a-4c87-9aca-0f3b17750292/init-config-reloader/0.log"
May 20 21:25:38.739641 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:38.739609    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6xk42_fa953017-fcf7-43f2-a33b-a3697bcc01f2/kube-state-metrics/0.log"
May 20 21:25:38.758932 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:38.758903    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6xk42_fa953017-fcf7-43f2-a33b-a3697bcc01f2/kube-rbac-proxy-main/0.log"
May 20 21:25:38.782649 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:38.782624    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6xk42_fa953017-fcf7-43f2-a33b-a3697bcc01f2/kube-rbac-proxy-self/0.log"
May 20 21:25:39.024095 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.024067    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wr6b6_4d473dd5-f422-4e9d-af0a-b0cd61270c76/node-exporter/0.log"
May 20 21:25:39.049369 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.049336    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wr6b6_4d473dd5-f422-4e9d-af0a-b0cd61270c76/kube-rbac-proxy/0.log"
May 20 21:25:39.072619 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.072592    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wr6b6_4d473dd5-f422-4e9d-af0a-b0cd61270c76/init-textfile/0.log"
May 20 21:25:39.106612 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.106524    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-flvpm_ed0cba94-3573-4887-86a5-32d8c4c47963/kube-rbac-proxy-main/0.log"
May 20 21:25:39.142675 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.142645    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-flvpm_ed0cba94-3573-4887-86a5-32d8c4c47963/kube-rbac-proxy-self/0.log"
May 20 21:25:39.183041 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.182996    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-flvpm_ed0cba94-3573-4887-86a5-32d8c4c47963/openshift-state-metrics/0.log"
May 20 21:25:39.486272 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.486242    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-kpbws_ddd98270-e4ae-418e-ab09-44c6eb96d51e/prometheus-operator-admission-webhook/0.log"
May 20 21:25:39.590037 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.589994    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68bc756c4c-m8c29_46dbc865-2b0a-4427-aebe-1d31be27d729/thanos-query/0.log"
May 20 21:25:39.616544 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.616516    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68bc756c4c-m8c29_46dbc865-2b0a-4427-aebe-1d31be27d729/kube-rbac-proxy-web/0.log"
May 20 21:25:39.640340 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.640308    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68bc756c4c-m8c29_46dbc865-2b0a-4427-aebe-1d31be27d729/kube-rbac-proxy/0.log"
May 20 21:25:39.669022 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.668997    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68bc756c4c-m8c29_46dbc865-2b0a-4427-aebe-1d31be27d729/prom-label-proxy/0.log"
May 20 21:25:39.695034 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.694997    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68bc756c4c-m8c29_46dbc865-2b0a-4427-aebe-1d31be27d729/kube-rbac-proxy-rules/0.log"
May 20 21:25:39.719609 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:39.719584    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68bc756c4c-m8c29_46dbc865-2b0a-4427-aebe-1d31be27d729/kube-rbac-proxy-metrics/0.log"
May 20 21:25:40.193713 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.190500    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"]
May 20 21:25:40.197626 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.197597    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"]
May 20 21:25:40.197788 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.197732    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.264799 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.264755    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-proc\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.264992 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.264822    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-sys\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.264992 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.264896    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffjqs\" (UniqueName: \"kubernetes.io/projected/6deaf51b-527a-4616-a358-0e302693b503-kube-api-access-ffjqs\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.264992 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.264942    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-podres\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.265171 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.265066    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-lib-modules\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.366295 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.366246    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-lib-modules\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.366479 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.366346    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-proc\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.366479 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.366388    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-sys\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.366479 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.366418    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffjqs\" (UniqueName: \"kubernetes.io/projected/6deaf51b-527a-4616-a358-0e302693b503-kube-api-access-ffjqs\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.366479 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.366421    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-lib-modules\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.366479 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.366469    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-proc\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.366690 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.366488    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-podres\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.366690 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.366504    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-sys\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.366690 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.366621    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6deaf51b-527a-4616-a358-0e302693b503-podres\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.376907 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.376875    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffjqs\" (UniqueName: \"kubernetes.io/projected/6deaf51b-527a-4616-a358-0e302693b503-kube-api-access-ffjqs\") pod \"perf-node-gather-daemonset-k98pq\" (UID: \"6deaf51b-527a-4616-a358-0e302693b503\") " pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.512024 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.511932    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:40.679210 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.679182    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"]
May 20 21:25:40.681913 ip-10-0-142-248 kubenswrapper[2556]: W0520 21:25:40.681874    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6deaf51b_527a_4616_a358_0e302693b503.slice/crio-04686e041d6a38945dc31f5eba1ed92e16aab16b7b52de5964892e9e694b023f WatchSource:0}: Error finding container 04686e041d6a38945dc31f5eba1ed92e16aab16b7b52de5964892e9e694b023f: Status 404 returned error can't find the container with id 04686e041d6a38945dc31f5eba1ed92e16aab16b7b52de5964892e9e694b023f
May 20 21:25:40.738260 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:40.738200    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq" event={"ID":"6deaf51b-527a-4616-a358-0e302693b503","Type":"ContainerStarted","Data":"04686e041d6a38945dc31f5eba1ed92e16aab16b7b52de5964892e9e694b023f"}
May 20 21:25:41.749222 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:41.749188    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq" event={"ID":"6deaf51b-527a-4616-a358-0e302693b503","Type":"ContainerStarted","Data":"0f7dd8be0aa64a591b62c0651eee2a7ff84db6cb3ba55c16cc081bc4dd1032c5"}
May 20 21:25:41.749607 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:41.749299    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:41.768778 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:41.768723    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq" podStartSLOduration=1.7687053719999999 podStartE2EDuration="1.768705372s" podCreationTimestamp="2026-05-20 21:25:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:25:41.765677516 +0000 UTC m=+2214.695274255" watchObservedRunningTime="2026-05-20 21:25:41.768705372 +0000 UTC m=+2214.698302110"
May 20 21:25:41.906089 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:41.906055    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5486cd7785-rwgsb_003a34fc-68b1-4e4b-b342-b352e3ff68ac/console/0.log"
May 20 21:25:43.413723 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:43.413695    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9vj5g_816319b6-b54d-45b8-8bdb-1f75b0e672f9/dns/0.log"
May 20 21:25:43.436880 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:43.436859    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9vj5g_816319b6-b54d-45b8-8bdb-1f75b0e672f9/kube-rbac-proxy/0.log"
May 20 21:25:43.463220 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:43.463191    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xmllx_bf8a3989-f2f8-4bb7-a1de-9d400bc27a70/dns-node-resolver/0.log"
May 20 21:25:44.029240 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:44.029190    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7g48h_70a22dd4-17d1-4946-9a36-891f152790aa/node-ca/0.log"
May 20 21:25:44.960112 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:44.960071    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bqvpmj_c763f752-5529-4473-8c0d-c8834f1a14ff/istio-proxy/0.log"
May 20 21:25:45.270147 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:45.270063    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-2hw6v_e9b3607d-c1b2-49ec-adae-dcf1005c67d2/istio-proxy/0.log"
May 20 21:25:45.401237 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:45.401202    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bd77c4d94-5l8ck_f4402bc2-97c9-4867-8e96-4938d325a1fa/router/0.log"
May 20 21:25:45.915619 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:45.915583    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h2df2_48b7525a-3a26-423d-9eb2-64ea2179f1d3/serve-healthcheck-canary/0.log"
May 20 21:25:46.427101 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:46.427054    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-xp8tn_ed3815d4-6e62-48d0-93c5-cd5e306c1b5d/insights-operator/0.log"
May 20 21:25:46.427834 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:46.427805    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-xp8tn_ed3815d4-6e62-48d0-93c5-cd5e306c1b5d/insights-operator/1.log"
May 20 21:25:46.451542 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:46.451515    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8l6gm_c597892d-533a-4fc1-8c44-7a04062a046f/kube-rbac-proxy/0.log"
May 20 21:25:46.474569 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:46.474545    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8l6gm_c597892d-533a-4fc1-8c44-7a04062a046f/exporter/0.log"
May 20 21:25:46.498100 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:46.498080    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8l6gm_c597892d-533a-4fc1-8c44-7a04062a046f/extractor/0.log"
May 20 21:25:47.762999 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:47.762965    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s85mv/perf-node-gather-daemonset-k98pq"
May 20 21:25:48.769943 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:48.769911    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655195-x5ttq_d1cefcf0-0559-4a2e-9e54-db90840bb2be/cleanup/0.log"
May 20 21:25:48.885517 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:48.885481    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7d4467948-86wvj_919f8cd3-47b0-4c50-8226-fd7f6bc8d2a6/manager/0.log"
May 20 21:25:48.990642 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:48.990603    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d5db49587-6mwxx_ee799f6b-6177-4a2d-86e2-6fc02d325435/manager/0.log"
May 20 21:25:50.551879 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:50.551826    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d8d69f6f7-7nc4h_757c80eb-6191-4da2-9743-701cc6164258/manager/0.log"
May 20 21:25:55.054427 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:55.054399    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-7pds6_8c6e0138-28fd-4958-986a-b548e8a86cdc/migrator/0.log"
May 20 21:25:55.076235 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:55.076203    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-7pds6_8c6e0138-28fd-4958-986a-b548e8a86cdc/graceful-termination/0.log"
May 20 21:25:56.586259 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:56.586232    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h629x_c0ec725c-067e-4f6d-a767-fbdc82cd6bd3/kube-multus-additional-cni-plugins/0.log"
May 20 21:25:56.620391 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:56.620353    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h629x_c0ec725c-067e-4f6d-a767-fbdc82cd6bd3/egress-router-binary-copy/0.log"
May 20 21:25:56.661046 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:56.661018    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h629x_c0ec725c-067e-4f6d-a767-fbdc82cd6bd3/cni-plugins/0.log"
May 20 21:25:56.702908 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:56.702883    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h629x_c0ec725c-067e-4f6d-a767-fbdc82cd6bd3/bond-cni-plugin/0.log"
May 20 21:25:56.735944 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:56.735922    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h629x_c0ec725c-067e-4f6d-a767-fbdc82cd6bd3/routeoverride-cni/0.log"
May 20 21:25:56.775004 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:56.774976    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h629x_c0ec725c-067e-4f6d-a767-fbdc82cd6bd3/whereabouts-cni-bincopy/0.log"
May 20 21:25:56.813811 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:56.813789    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h629x_c0ec725c-067e-4f6d-a767-fbdc82cd6bd3/whereabouts-cni/0.log"
May 20 21:25:57.115380 ip-10-0-142-248 kubenswrapper[2556]: I0520 21:25:57.115348    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xc75b_63402a4a-5a2e-4982-bcbd-8b4a1873ff73/kube-multus/0.log"