May 28 18:23:39.924329 ip-10-0-138-216 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 18:23:39.924341 ip-10-0-138-216 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 18:23:39.924348 ip-10-0-138-216 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 18:23:39.924717 ip-10-0-138-216 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 18:23:50.015521 ip-10-0-138-216 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 18:23:50.015540 ip-10-0-138-216 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ab512b14a6f0445b8cf40d2de3e95b69 --
May 28 18:26:09.270116 ip-10-0-138-216 systemd[1]: Starting Kubernetes Kubelet...
May 28 18:26:09.782238 ip-10-0-138-216 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:26:09.782238 ip-10-0-138-216 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 18:26:09.782238 ip-10-0-138-216 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:26:09.782238 ip-10-0-138-216 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 18:26:09.782238 ip-10-0-138-216 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:26:09.783961 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.783868    2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 18:26:09.787484 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787469    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:26:09.787484 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787484    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787487    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787491    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787494    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787496    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787499    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787502    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787504    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787508    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787511    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787514    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787517    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787520    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787529    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787532    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787535    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787538    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787540    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787543    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787545    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:26:09.787550 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787548    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787550    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787553    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787556    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787559    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787562    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787565    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787567    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787570    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787572    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787575    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787578    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787580    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787583    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787585    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787587    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787590    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787592    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787595    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787597    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:26:09.788046 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787600    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787602    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787607    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787610    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787614    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787616    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787620    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787622    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787628    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787631    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787634    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787637    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787639    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787642    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787645    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787648    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787651    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787653    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787656    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:26:09.788534 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787658    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787661    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787663    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787666    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787669    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787672    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787674    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787677    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787680    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787683    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787686    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787689    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787691    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787694    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787697    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787699    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787701    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787704    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787706    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787709    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:26:09.789182 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787712    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:26:09.789814 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787715    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:26:09.789814 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787731    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:26:09.789814 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787734    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:26:09.789814 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787737    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:26:09.789814 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.787739    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:26:09.790008 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.789992    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:26:09.790008 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790006    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:26:09.790008 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790010    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790013    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790016    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790018    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790021    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790024    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790027    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790029    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790032    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790034    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790037    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790040    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790042    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790045    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790047    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790050    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790053    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790055    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790058    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790061    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:26:09.790093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790063    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790067    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790069    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790072    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790075    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790078    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790080    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790083    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790085    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790088    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790092    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790096    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790100    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790103    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790106    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790109    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790112    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790114    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790117    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790121    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:26:09.790573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790124    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790126    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790129    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790132    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790135    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790137    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790140    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790142    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790145    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790148    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790150    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790153    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790155    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790158    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790162    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790165    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790167    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790170    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790173    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790175    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:26:09.791100 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790178    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790181    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790183    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790186    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790188    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790191    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790193    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790196    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790198    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790201    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790203    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790206    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790209    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790211    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790214    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790216    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790220    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790222    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790225    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:26:09.791581 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790228    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790232    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790236    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790239    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790241    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790316    2562 flags.go:64] FLAG: --address="0.0.0.0"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790324    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790331    2562 flags.go:64] FLAG: --anonymous-auth="true"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790336    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790340    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790343    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790348    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790352    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790355    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790358    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790362    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790366    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790369    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790371    2562 flags.go:64] FLAG: --cgroup-root=""
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790374    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790377    2562 flags.go:64] FLAG: --client-ca-file=""
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790380    2562 flags.go:64] FLAG: --cloud-config=""
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790383    2562 flags.go:64] FLAG: --cloud-provider="external"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790386    2562 flags.go:64] FLAG: --cluster-dns="[]"
May 28 18:26:09.792058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790390    2562 flags.go:64] FLAG: --cluster-domain=""
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790393    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790396    2562 flags.go:64] FLAG: --config-dir=""
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790399    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790402    2562 flags.go:64] FLAG: --container-log-max-files="5"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790406    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790410    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790413    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790417    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790420    2562 flags.go:64] FLAG: --contention-profiling="false"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790423    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790426    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790429    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790433    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790437    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790442    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790444    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790447    2562 flags.go:64] FLAG: --enable-load-reader="false"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790451    2562 flags.go:64] FLAG: --enable-server="true"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790454    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790459    2562 flags.go:64] FLAG: --event-burst="100"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790462    2562 flags.go:64] FLAG: --event-qps="50"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790465    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790468    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790471    2562 flags.go:64] FLAG: --eviction-hard=""
May 28 18:26:09.792633 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790475    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790477    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790481    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790484    2562 flags.go:64] FLAG: --eviction-soft=""
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790487    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790489    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790492    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790495    2562 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790498    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790501    2562 flags.go:64] FLAG: --fail-swap-on="true"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790504    2562 flags.go:64] FLAG: --feature-gates=""
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790508    2562 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790512    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790515    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790519    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790522    2562 flags.go:64] FLAG: --healthz-port="10248"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790525    2562 flags.go:64] FLAG: --help="false"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790528    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-138-216.ec2.internal"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790531    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790534    2562 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790537    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790540    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790544    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790547    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 18:26:09.793263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790550    2562 flags.go:64] FLAG: --image-service-endpoint=""
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790553    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790556    2562 flags.go:64] FLAG: --kube-api-burst="100"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790559    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790562    2562 flags.go:64] FLAG: --kube-api-qps="50"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790565    2562 flags.go:64] FLAG: --kube-reserved=""
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790568    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790570    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790574    2562 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790577    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790580    2562 flags.go:64] FLAG: --lock-file=""
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790583    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790586    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790589    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790594    2562 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790597    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790601    2562 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790603    2562 flags.go:64] FLAG: --logging-format="text"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790606    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790610    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790613    2562 flags.go:64] FLAG: --manifest-url=""
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790616    2562 flags.go:64] FLAG: --manifest-url-header=""
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790620    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790624    2562 flags.go:64] FLAG: --max-open-files="1000000"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790628    2562 flags.go:64] FLAG: --max-pods="110"
May 28 18:26:09.793947 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790631    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790635    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790637    2562 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790641    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790644    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790647    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790650    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790658    2562 flags.go:64] FLAG: --node-status-max-images="50"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790661    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790663    2562 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790666    2562 flags.go:64] FLAG: --pod-cidr=""
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790669    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790675    2562 flags.go:64] FLAG: --pod-manifest-path=""
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790679    2562 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790682    2562 flags.go:64] FLAG: --pods-per-core="0"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790685    2562 flags.go:64] FLAG: --port="10250"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790688    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790691    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09c96ef733270b95c"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790694    2562 flags.go:64] FLAG: --qos-reserved=""
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790697    2562 flags.go:64] FLAG: --read-only-port="10255"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790700    2562 flags.go:64] FLAG: --register-node="true"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790703    2562 flags.go:64] FLAG: --register-schedulable="true"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790706    2562 flags.go:64] FLAG: --register-with-taints=""
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790710    2562 flags.go:64] FLAG: --registry-burst="10"
May 28 18:26:09.794561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790713    2562 flags.go:64] FLAG: --registry-qps="5"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790715    2562 flags.go:64] FLAG: --reserved-cpus=""
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790735    2562 flags.go:64] FLAG: --reserved-memory=""
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790739    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790742    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790745    2562 flags.go:64] FLAG: --rotate-certificates="false"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790748    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790751    2562 flags.go:64] FLAG: --runonce="false"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790755    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790758    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790761    2562 flags.go:64] FLAG: --seccomp-default="false"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790764    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790767    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790770    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790773    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790776    2562 flags.go:64] FLAG: --storage-driver-password="root"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790779    2562 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790782    2562 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790785    2562 flags.go:64] FLAG: --storage-driver-user="root"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790788    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790791    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790794    2562 flags.go:64] FLAG: --system-cgroups=""
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790797    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790803    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790806    2562 flags.go:64] FLAG: --tls-cert-file=""
May 28 18:26:09.795208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790809    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790813    2562 flags.go:64] FLAG: --tls-min-version=""
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790816    2562 flags.go:64] FLAG: --tls-private-key-file=""
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790818    2562 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790821    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790824    2562 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790827    2562 flags.go:64] FLAG: --v="2"
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790831    2562 flags.go:64] FLAG: --version="false"
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790836    2562 flags.go:64] FLAG: --vmodule=""
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790840    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.790843    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790939    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790942    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790946    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790950    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790953    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790957    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790959    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790962    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790965    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790967    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790971    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:26:09.795825 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790975    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790978    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790981    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790984    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790986    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790989    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790991    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790994    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790996    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.790999    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791001    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791004    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791006    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791009    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791011    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791014    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791016    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791019    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791021    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791024    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:26:09.796353 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791027    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791030    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791032    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791035    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791038    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791041    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791044    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791047    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791049    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791052    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791055    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791057    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791060    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791062    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791065    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791067    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791070    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791072    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791075    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:26:09.796933 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791077    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791080    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791082    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791085    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791087    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791090    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791092    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791095    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791097    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791100    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791102    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791105    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791108    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791111    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791114    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791117    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791120    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791122    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791125    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791128    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:26:09.797421 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791131    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791133    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791136    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791138    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791141    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791143    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791146    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791149    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791151    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791153    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791156    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791158    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791161    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791163    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791166    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:26:09.797932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.791170    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:26:09.798332 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.791798    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:26:09.798332 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.798259    2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 18:26:09.798332 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.798275    2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 18:26:09.798332 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798324    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:26:09.798332 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798329    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:26:09.798332 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798333    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798336    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798339    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798342    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798345    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798347    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798350    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798353    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798355    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798358    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798361    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798363    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798366    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798368    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798371    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798374    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798376    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798379    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798381    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798384    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:26:09.798491 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798386    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798389    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798391    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798394    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798396    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798399    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798402    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798404    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798407    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798410    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798413    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798415    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798418    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798420    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798424    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798426    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798429    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798431    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798434    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798436    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:26:09.799021 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798440    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798445    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798448    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798451    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798454    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798457    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798460    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798462    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798466    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798470    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798473    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798476    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798479    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798482    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798485    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798488    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798491    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798493    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798496    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:26:09.799522 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798499    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798502    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798504    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798507    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798510    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798512    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798515    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798518    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798521    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798523    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798526    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798529    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798532    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798534    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798537    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798540    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798542    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798545    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798548    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798550    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:26:09.800004 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798552    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798555    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798558    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798560    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798562    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.798567    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798687    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798693    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798696    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798699    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798701    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798704    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798707    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798709    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798712    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798714    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:26:09.800492 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798734    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798737    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798740    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798743    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798746    2562 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798749    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798752    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798755    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798757    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798760    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798763    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798765    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798768    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798771    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798773    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798776    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798779    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798781    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798785    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:26:09.800920 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798789    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798791    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798795    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798797    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798800    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798802    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798805    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798808    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798811    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798813    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798816    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798819    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798822    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798825    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798828    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798831    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798834    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798837    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798840    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798842    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:26:09.801378 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798845    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798848    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798850    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798853    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798856    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798859    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798861    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798864    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798867    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798869    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798872    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798874    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798877    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798879    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798882    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798884    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798887    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798889    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798892    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798895    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:26:09.801932 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798898    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798900    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798903    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798905    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798908    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798910    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798913    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798918    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798922    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798925    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798927    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798930    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798932    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798935    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798937    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798939    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:26:09.802418 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:09.798942    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:26:09.802824 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.798946    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:26:09.802824 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.799876    2562 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 18:26:09.803482 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.803469    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 18:26:09.804616 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.804604    2562 server.go:1019] "Starting client certificate rotation"
May 28 18:26:09.804730 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.804704    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 18:26:09.804767 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.804754    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 18:26:09.831681 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.831658    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 18:26:09.833779 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.833756    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 18:26:09.850637 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.850614    2562 log.go:25] "Validated CRI v1 runtime API"
May 28 18:26:09.861110 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.861089    2562 log.go:25] "Validated CRI v1 image API"
May 28 18:26:09.862299 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.862280    2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 18:26:09.862393 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.862327    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 18:26:09.865014 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.864995    2562 fs.go:135] Filesystem UUIDs: map[42d40519-5069-4bba-9c81-0b5545589f64:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7c5f6b20-50ef-4ad2-88af-16988ff2a7a1:/dev/nvme0n1p4]
May 28 18:26:09.865059 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.865016    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 18:26:09.869323 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.869221    2562 manager.go:217] Machine: {Timestamp:2026-05-28 18:26:09.868714675 +0000 UTC m=+0.458324307 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098393 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22db923802853bd8454f1b64e77106 SystemUUID:ec22db92-3802-853b-d845-4f1b64e77106 BootID:ab512b14-a6f0-445b-8cf4-0d2de3e95b69 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:e8:9e:5e:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:e8:9e:5e:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:2d:26:d2:fe:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 18:26:09.870372 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.870361    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 18:26:09.870488 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.870475    2562 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 18:26:09.874001 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.873968    2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 18:26:09.874134 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.874003    2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-216.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 18:26:09.874183 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.874143    2562 topology_manager.go:138] "Creating topology manager with none policy"
May 28 18:26:09.874183 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.874150    2562 container_manager_linux.go:306] "Creating device plugin manager"
May 28 18:26:09.874183 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.874157    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 18:26:09.874183 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.874177    2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 18:26:09.876169 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.876158    2562 state_mem.go:36] "Initialized new in-memory state store"
May 28 18:26:09.876310 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.876301    2562 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 18:26:09.878924 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.878914    2562 kubelet.go:491] "Attempting to sync node with API server"
May 28 18:26:09.878968 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.878928    2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 18:26:09.878968 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.878941    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 18:26:09.878968 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.878950    2562 kubelet.go:397] "Adding apiserver pod source"
May 28 18:26:09.878968 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.878959    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 18:26:09.880346 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.880333    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 18:26:09.880416 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.880353    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 18:26:09.882466 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.882395    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t5dhd"
May 28 18:26:09.884697 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.884677    2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 18:26:09.886733 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.886702    2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 18:26:09.887865 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.887848    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 18:26:09.887915 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.887879    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 18:26:09.887915 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.887893    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 18:26:09.887915 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.887906    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 18:26:09.887998 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.887922    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 18:26:09.887998 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.887935    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 18:26:09.887998 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.887948    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 18:26:09.887998 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.887960    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 18:26:09.887998 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.887975    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 18:26:09.887998 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.887987    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 18:26:09.888149 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.888006    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 18:26:09.888229 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.888219    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 18:26:09.888970 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.888959    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 18:26:09.889023 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.888970    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 18:26:09.890026 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.890003    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t5dhd"
May 28 18:26:09.891117 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:09.891084    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 18:26:09.891117 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:09.891093    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 18:26:09.892455 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.892440    2562 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 18:26:09.892515 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.892482    2562 server.go:1295] "Started kubelet"
May 28 18:26:09.892571 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.892531    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 18:26:09.892621 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.892578    2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 18:26:09.892670 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.892639    2562 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 18:26:09.893204 ip-10-0-138-216 systemd[1]: Started Kubernetes Kubelet.
May 28 18:26:09.895631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.895615    2562 server.go:317] "Adding debug handlers to kubelet server"
May 28 18:26:09.895998 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.895856    2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 18:26:09.902828 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.902806    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 18:26:09.902920 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.902907    2562 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 18:26:09.902920 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.902919    2562 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 18:26:09.903025 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.902919    2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 18:26:09.903025 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.902939    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 18:26:09.903025 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:09.902948    2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 18:26:09.903157 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.903065    2562 reconstruct.go:97] "Volume reconstruction finished"
May 28 18:26:09.903157 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.903075    2562 reconciler.go:26] "Reconciler: start to sync state"
May 28 18:26:09.903641 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.903623    2562 factory.go:55] Registering systemd factory
May 28 18:26:09.903641 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.903643    2562 factory.go:223] Registration of the systemd container factory successfully
May 28 18:26:09.904005 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.903980    2562 factory.go:153] Registering CRI-O factory
May 28 18:26:09.904005 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.903999    2562 factory.go:223] Registration of the crio container factory successfully
May 28 18:26:09.904127 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.904106    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 18:26:09.904127 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.904124    2562 factory.go:103] Registering Raw factory
May 28 18:26:09.904226 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.904140    2562 manager.go:1196] Started watching for new ooms in manager
May 28 18:26:09.904539 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.904523    2562 manager.go:319] Starting recovery of all containers
May 28 18:26:09.905204 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:09.905148    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-216.ec2.internal\" not found"
May 28 18:26:09.906322 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.906303    2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:26:09.907503 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.907484    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-216.ec2.internal" not found
May 28 18:26:09.907597 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:09.907510    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-216.ec2.internal\" not found" node="ip-10-0-138-216.ec2.internal"
May 28 18:26:09.915152 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.915127    2562 manager.go:324] Recovery completed
May 28 18:26:09.916364 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:09.916338    2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 28 18:26:09.919175 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.919162    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:09.921164 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.921149    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:09.921229 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.921179    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:09.921229 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.921193    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:09.921668 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.921657    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 18:26:09.921668 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.921667    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 18:26:09.921801 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.921682    2562 state_mem.go:36] "Initialized new in-memory state store"
May 28 18:26:09.922893 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.922878    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-216.ec2.internal" not found
May 28 18:26:09.924118 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.924106    2562 policy_none.go:49] "None policy: Start"
May 28 18:26:09.924160 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.924124    2562 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 18:26:09.924160 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.924135    2562 state_mem.go:35] "Initializing new in-memory state store"
May 28 18:26:09.959298 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.959286    2562 manager.go:341] "Starting Device Plugin manager"
May 28 18:26:09.978350 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:09.959312    2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 18:26:09.978350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.959322    2562 server.go:85] "Starting device plugin registration server"
May 28 18:26:09.978350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.959557    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 18:26:09.978350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.959568    2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 18:26:09.978350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.959669    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 18:26:09.978350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.959767    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 18:26:09.978350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.959776    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 18:26:09.978350 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:09.960205    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 18:26:09.978350 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:09.960246    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-216.ec2.internal\" not found"
May 28 18:26:09.980138 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:09.980122    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-216.ec2.internal" not found
May 28 18:26:10.005811 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.005768    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 18:26:10.006958 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.006932    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 18:26:10.006958 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.006959    2562 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 18:26:10.007097 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.006981    2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 18:26:10.007097 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.006989    2562 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 18:26:10.007097 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.007034    2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 18:26:10.009205 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.009188    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:26:10.060893 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.060820    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:10.062174 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.062159    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:10.062260 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.062186    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:10.062260 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.062196    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:10.062260 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.062217    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-216.ec2.internal"
May 28 18:26:10.073102 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.073082    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-216.ec2.internal"
May 28 18:26:10.073160 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.073105    2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-216.ec2.internal\": node \"ip-10-0-138-216.ec2.internal\" not found"
May 28 18:26:10.089291 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.089268    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-216.ec2.internal\" not found"
May 28 18:26:10.107325 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.107297    2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-216.ec2.internal"]
May 28 18:26:10.107412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.107381    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:10.109085 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.109071    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:10.109154 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.109098    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:10.109154 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.109108    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:10.110499 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.110488    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:10.110634 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.110620    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.110685 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.110650    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:10.111382 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.111364    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:10.111463 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.111366    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:10.111463 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.111414    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:10.111463 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.111427    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:10.111463 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.111392    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:10.111463 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.111462    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:10.112898 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.112882    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.112949 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.112913    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:10.113571 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.113553    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:10.113649 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.113582    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:10.113649 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.113597    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:10.131215 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.131197    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-216.ec2.internal\" not found" node="ip-10-0-138-216.ec2.internal"
May 28 18:26:10.134933 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.134917    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-216.ec2.internal\" not found" node="ip-10-0-138-216.ec2.internal"
May 28 18:26:10.189980 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.189958    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-216.ec2.internal\" not found"
May 28 18:26:10.204732 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.204701    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2732cb86a6a883be1f4da26c8fe222aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal\" (UID: \"2732cb86a6a883be1f4da26c8fe222aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.204796 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.204742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2732cb86a6a883be1f4da26c8fe222aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal\" (UID: \"2732cb86a6a883be1f4da26c8fe222aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.204796 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.204767    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac25bcb2d036809e2b2845a0da4269f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-216.ec2.internal\" (UID: \"ac25bcb2d036809e2b2845a0da4269f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.290537 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.290508    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-216.ec2.internal\" not found"
May 28 18:26:10.304937 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.304916    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2732cb86a6a883be1f4da26c8fe222aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal\" (UID: \"2732cb86a6a883be1f4da26c8fe222aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.304991 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.304949    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac25bcb2d036809e2b2845a0da4269f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-216.ec2.internal\" (UID: \"ac25bcb2d036809e2b2845a0da4269f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.304991 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.304967    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2732cb86a6a883be1f4da26c8fe222aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal\" (UID: \"2732cb86a6a883be1f4da26c8fe222aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.305051 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.305015    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2732cb86a6a883be1f4da26c8fe222aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal\" (UID: \"2732cb86a6a883be1f4da26c8fe222aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.305089 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.305065    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ac25bcb2d036809e2b2845a0da4269f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-216.ec2.internal\" (UID: \"ac25bcb2d036809e2b2845a0da4269f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.305134 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.305093    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2732cb86a6a883be1f4da26c8fe222aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal\" (UID: \"2732cb86a6a883be1f4da26c8fe222aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.391594 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.391524    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-216.ec2.internal\" not found"
May 28 18:26:10.433922 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.433893    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.437680 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.437661    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.492385 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.492353    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-216.ec2.internal\" not found"
May 28 18:26:10.592825 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.592800    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-216.ec2.internal\" not found"
May 28 18:26:10.693403 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.693303    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-216.ec2.internal\" not found"
May 28 18:26:10.793936 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.793894    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-216.ec2.internal\" not found"
May 28 18:26:10.805149 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.805127    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 18:26:10.805299 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.805283    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 18:26:10.805336 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.805309    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 18:26:10.832936 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.832910    2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:26:10.869302 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.869280    2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:26:10.880173 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.880150    2562 apiserver.go:52] "Watching apiserver"
May 28 18:26:10.885782 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.885760    2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 18:26:10.887799 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.887772    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-2dmsn","openshift-multus/multus-additional-cni-plugins-z4ghf","openshift-multus/multus-n5lrf","kube-system/konnectivity-agent-jzfzd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj","openshift-multus/network-metrics-daemon-2jrmq","openshift-network-diagnostics/network-check-target-dswfb","openshift-network-operator/iptables-alerter-76dw6","openshift-ovn-kubernetes/ovnkube-node-x67nm","openshift-cluster-node-tuning-operator/tuned-g9drr","openshift-dns/node-resolver-d528j"]
May 28 18:26:10.889742 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.889715    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2dmsn"
May 28 18:26:10.891185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.891164    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:10.891574 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.891532    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 18:21:09 +0000 UTC" deadline="2027-12-09 02:18:36.996336798 +0000 UTC"
May 28 18:26:10.891574 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.891560    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13423h52m26.104778922s"
May 28 18:26:10.891890 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.891868    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 18:26:10.891976 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.891891    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cd76t\""
May 28 18:26:10.891976 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.891921    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 18:26:10.891976 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.891938    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 18:26:10.893074 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.893059    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 18:26:10.893473 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.893455    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 18:26:10.893591 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.893477    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 18:26:10.893709 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.893638    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.893709 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.893548    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gmmrp\""
May 28 18:26:10.893851 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.893741    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 18:26:10.893851 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.893557    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 18:26:10.895016 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.894997    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:10.895147 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.895129    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:10.895353 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.895335    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8xzlp\""
May 28 18:26:10.895430 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.895391    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 18:26:10.896602 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.896585    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 18:26:10.896663 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.896602    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:10.896713 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.896658    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:10.896791 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.896709    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 18:26:10.896834 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.896802    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 18:26:10.897834 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.897275    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 18:26:10.897834 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.897612    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xtpg4\""
May 28 18:26:10.897834 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.897668    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 18:26:10.897834 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.897698    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xhnrz\""
May 28 18:26:10.899015 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.898208    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:10.899015 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:10.898311    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:10.899894 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.899877    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-76dw6"
May 28 18:26:10.901243 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.901220    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.901834 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.901817    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 18:26:10.901909 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.901872    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 18:26:10.901963 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.901934    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mvgfh\""
May 28 18:26:10.902016 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.901972    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 18:26:10.902360 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.902336    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.903124 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.903106    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 18:26:10.903215 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.903126    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 18:26:10.903215 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.903191    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 18:26:10.903323 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.903248    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4xqgx\""
May 28 18:26:10.903323 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.903114    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 18:26:10.903417 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.903350    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 18:26:10.903417 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.903405    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.903871 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.903672    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 18:26:10.903871 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.903693    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 18:26:10.904179 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.904161    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d528j"
May 28 18:26:10.904251 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.904222    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 18:26:10.904251 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.904225    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vznln\""
May 28 18:26:10.904865 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.904845    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 18:26:10.906151 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.905853    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 18:26:10.906151 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.906087    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fkdms\""
May 28 18:26:10.906329 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.906313    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 18:26:10.909238 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-run-netns\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.909310 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c85ab10-3394-4dc4-a3e4-7419efb552bf-konnectivity-ca\") pod \"konnectivity-agent-jzfzd\" (UID: \"4c85ab10-3394-4dc4-a3e4-7419efb552bf\") " pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:10.909310 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909270    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pz9l\" (UniqueName: \"kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l\") pod \"network-check-target-dswfb\" (UID: \"b56fcf23-ddc9-450c-bcf5-a58d5609cc25\") " pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:10.909310 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-etc-selinux\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:10.909403 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e845702-c1e8-4dec-907a-773ed9ab8137-hosts-file\") pod \"node-resolver-d528j\" (UID: \"8e845702-c1e8-4dec-907a-773ed9ab8137\") " pod="openshift-dns/node-resolver-d528j"
May 28 18:26:10.909403 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-cnibin\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:10.909403 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7239413-938b-42bb-bad9-d4e42c0e0599-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:10.909536 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13d06b62-8ab7-4492-b886-386083b47d5f-ovnkube-config\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.909536 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-sysctl-d\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.909536 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-cnibin\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.909536 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-var-lib-cni-multus\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.909536 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909492    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fa04bf8-03bc-4b67-8bdd-014f33f75a47-host-slash\") pod \"iptables-alerter-76dw6\" (UID: \"0fa04bf8-03bc-4b67-8bdd-014f33f75a47\") " pod="openshift-network-operator/iptables-alerter-76dw6"
May 28 18:26:10.909536 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909506    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-run-openvswitch\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.909536 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909528    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.909756 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13d06b62-8ab7-4492-b886-386083b47d5f-ovnkube-script-lib\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.909756 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-var-lib-kubelet\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.909756 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-var-lib-kubelet\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.909756 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-etc-kubernetes\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.909756 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-os-release\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:10.909756 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0fa04bf8-03bc-4b67-8bdd-014f33f75a47-iptables-alerter-script\") pod \"iptables-alerter-76dw6\" (UID: \"0fa04bf8-03bc-4b67-8bdd-014f33f75a47\") " pod="openshift-network-operator/iptables-alerter-76dw6"
May 28 18:26:10.909756 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-run-ovn\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.909756 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-sysconfig\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.909756 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-lib-modules\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.909756 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909712    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-run-netns\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.909756 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909746    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ac7180b-8d0f-4c78-ad91-ec4104359bcc-host\") pod \"node-ca-2dmsn\" (UID: \"3ac7180b-8d0f-4c78-ad91-ec4104359bcc\") " pod="openshift-image-registry/node-ca-2dmsn"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzd46\" (UniqueName: \"kubernetes.io/projected/f7239413-938b-42bb-bad9-d4e42c0e0599-kube-api-access-gzd46\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909777    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zttm\" (UniqueName: \"kubernetes.io/projected/13d06b62-8ab7-4492-b886-386083b47d5f-kube-api-access-6zttm\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-tmp\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c85ab10-3394-4dc4-a3e4-7419efb552bf-agent-certs\") pod \"konnectivity-agent-jzfzd\" (UID: \"4c85ab10-3394-4dc4-a3e4-7419efb552bf\") " pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-systemd-units\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-var-lib-openvswitch\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-socket-dir-parent\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909902    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-sys-fs\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909916    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-run-multus-certs\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e845702-c1e8-4dec-907a-773ed9ab8137-tmp-dir\") pod \"node-resolver-d528j\" (UID: \"8e845702-c1e8-4dec-907a-773ed9ab8137\") " pod="openshift-dns/node-resolver-d528j"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ac7180b-8d0f-4c78-ad91-ec4104359bcc-serviceca\") pod \"node-ca-2dmsn\" (UID: \"3ac7180b-8d0f-4c78-ad91-ec4104359bcc\") " pod="openshift-image-registry/node-ca-2dmsn"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7239413-938b-42bb-bad9-d4e42c0e0599-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-run-systemd\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.909997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-cni-bin\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-sys\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-host\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.910129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-os-release\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-cni-binary-copy\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910071    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-etc-openvswitch\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7239413-938b-42bb-bad9-d4e42c0e0599-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910117    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-slash\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13d06b62-8ab7-4492-b886-386083b47d5f-ovn-node-metrics-cert\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhqb8\" (UniqueName: \"kubernetes.io/projected/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-kube-api-access-hhqb8\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvfz6\" (UniqueName: \"kubernetes.io/projected/26b71d0c-8000-421e-b031-4805782b9c85-kube-api-access-gvfz6\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910226    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-system-cni-dir\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-kubernetes\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-systemd\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910295    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxcjs\" (UniqueName: \"kubernetes.io/projected/0fa04bf8-03bc-4b67-8bdd-014f33f75a47-kube-api-access-nxcjs\") pod \"iptables-alerter-76dw6\" (UID: \"0fa04bf8-03bc-4b67-8bdd-014f33f75a47\") " pod="openshift-network-operator/iptables-alerter-76dw6"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-tuned\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl94v\" (UniqueName: \"kubernetes.io/projected/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-kube-api-access-hl94v\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-hostroot\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.910921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-conf-dir\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-registration-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13d06b62-8ab7-4492-b886-386083b47d5f-env-overrides\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-modprobe-d\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-system-cni-dir\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-cni-dir\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4dc7\" (UniqueName: \"kubernetes.io/projected/8e845702-c1e8-4dec-907a-773ed9ab8137-kube-api-access-h4dc7\") pod \"node-resolver-d528j\" (UID: \"8e845702-c1e8-4dec-907a-773ed9ab8137\") " pod="openshift-dns/node-resolver-d528j"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910590    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-kubelet\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-log-socket\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910656    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-cni-netd\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-var-lib-cni-bin\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-daemon-config\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vf58\" (UniqueName: \"kubernetes.io/projected/3ac7180b-8d0f-4c78-ad91-ec4104359bcc-kube-api-access-5vf58\") pod \"node-ca-2dmsn\" (UID: \"3ac7180b-8d0f-4c78-ad91-ec4104359bcc\") " pod="openshift-image-registry/node-ca-2dmsn"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-node-log\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:10.911412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-run-k8s-cni-cncf-io\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:10.911877 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-socket-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:10.911877 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25vbp\" (UniqueName: \"kubernetes.io/projected/c0589b10-d76a-415e-a5a5-90d769094542-kube-api-access-25vbp\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:10.911877 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910947    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-sysctl-conf\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.911877 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.910973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-run\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:10.911877 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.911017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-device-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:10.911877 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.911042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:10.913289 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.913273    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal"]
May 28 18:26:10.913771 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.913746    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 18:26:10.913867 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.913814    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-216.ec2.internal"
May 28 18:26:10.915059 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.915043    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 18:26:10.921108 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.921091    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 18:26:10.921217 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.921113    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-216.ec2.internal"]
May 28 18:26:10.933922 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.933905    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xbnj2"
May 28 18:26:10.940020 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.940002    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xbnj2"
May 28 18:26:10.973887 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:10.973858    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2732cb86a6a883be1f4da26c8fe222aa.slice/crio-b3f41fa69bb8846ecafaa2181efbf461224803d44a763c472ac817ff05d82c81 WatchSource:0}: Error finding container b3f41fa69bb8846ecafaa2181efbf461224803d44a763c472ac817ff05d82c81: Status 404 returned error can't find the container with id b3f41fa69bb8846ecafaa2181efbf461224803d44a763c472ac817ff05d82c81
May 28 18:26:10.974114 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:10.974098    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac25bcb2d036809e2b2845a0da4269f7.slice/crio-e034cb7a0c89303b292ea3ac233879a534d3c4c674e62c8644cd6f519545ddd4 WatchSource:0}: Error finding container e034cb7a0c89303b292ea3ac233879a534d3c4c674e62c8644cd6f519545ddd4: Status 404 returned error can't find the container with id e034cb7a0c89303b292ea3ac233879a534d3c4c674e62c8644cd6f519545ddd4
May 28 18:26:10.977510 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:10.977494    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:26:11.003919 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.003902    2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 18:26:11.010171 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.010132    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-216.ec2.internal" event={"ID":"ac25bcb2d036809e2b2845a0da4269f7","Type":"ContainerStarted","Data":"e034cb7a0c89303b292ea3ac233879a534d3c4c674e62c8644cd6f519545ddd4"}
May 28 18:26:11.011040 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011008    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal" event={"ID":"2732cb86a6a883be1f4da26c8fe222aa","Type":"ContainerStarted","Data":"b3f41fa69bb8846ecafaa2181efbf461224803d44a763c472ac817ff05d82c81"}
May 28 18:26:11.011255 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011240    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-etc-openvswitch\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.011297 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011265    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7239413-938b-42bb-bad9-d4e42c0e0599-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.011335 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011297    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-slash\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.011374 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011344    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-slash\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.011374 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011344    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-etc-openvswitch\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.011441 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011378    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13d06b62-8ab7-4492-b886-386083b47d5f-ovn-node-metrics-cert\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.011441 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011402    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqb8\" (UniqueName: \"kubernetes.io/projected/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-kube-api-access-hhqb8\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.011441 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011435    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvfz6\" (UniqueName: \"kubernetes.io/projected/26b71d0c-8000-421e-b031-4805782b9c85-kube-api-access-gvfz6\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:11.011558 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011460    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-system-cni-dir\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.011558 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011485    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-kubernetes\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.011558 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011509    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-systemd\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.011693 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011561    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.011693 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011599    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-system-cni-dir\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.011693 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011607    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxcjs\" (UniqueName: \"kubernetes.io/projected/0fa04bf8-03bc-4b67-8bdd-014f33f75a47-kube-api-access-nxcjs\") pod \"iptables-alerter-76dw6\" (UID: \"0fa04bf8-03bc-4b67-8bdd-014f33f75a47\") " pod="openshift-network-operator/iptables-alerter-76dw6"
May 28 18:26:11.011693 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011641    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-tuned\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.011693 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011647    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.011693 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011666    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hl94v\" (UniqueName: \"kubernetes.io/projected/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-kube-api-access-hl94v\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.011693 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011692    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-hostroot\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011713    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-systemd\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011717    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-conf-dir\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011753    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011777    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-registration-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011794    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-hostroot\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011803    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13d06b62-8ab7-4492-b886-386083b47d5f-env-overrides\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011894    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7239413-938b-42bb-bad9-d4e42c0e0599-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011930    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-modprobe-d\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011960    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-system-cni-dir\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011959    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-conf-dir\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012021    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-system-cni-dir\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.012034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012035    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-registration-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012059    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-cni-dir\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012076    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-modprobe-d\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012095    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4dc7\" (UniqueName: \"kubernetes.io/projected/8e845702-c1e8-4dec-907a-773ed9ab8137-kube-api-access-h4dc7\") pod \"node-resolver-d528j\" (UID: \"8e845702-c1e8-4dec-907a-773ed9ab8137\") " pod="openshift-dns/node-resolver-d528j"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012120    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-kubelet\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012144    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-log-socket\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012147    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-cni-dir\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012166    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-cni-netd\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012185    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-kubelet\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012188    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-var-lib-cni-bin\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012200    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13d06b62-8ab7-4492-b886-386083b47d5f-env-overrides\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012215    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-var-lib-cni-bin\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012224    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-daemon-config\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012247    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-log-socket\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012260    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-cni-netd\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.011568    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-kubernetes\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012263    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vf58\" (UniqueName: \"kubernetes.io/projected/3ac7180b-8d0f-4c78-ad91-ec4104359bcc-kube-api-access-5vf58\") pod \"node-ca-2dmsn\" (UID: \"3ac7180b-8d0f-4c78-ad91-ec4104359bcc\") " pod="openshift-image-registry/node-ca-2dmsn"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012309    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.012569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012336    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-node-log\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012362    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-node-log\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012411    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-run-k8s-cni-cncf-io\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012427    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-run-ovn-kubernetes\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012436    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-socket-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012463    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-25vbp\" (UniqueName: \"kubernetes.io/projected/c0589b10-d76a-415e-a5a5-90d769094542-kube-api-access-25vbp\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012464    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-run-k8s-cni-cncf-io\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012473    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012521    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-sysctl-conf\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012548    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-run\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012558    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-socket-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012570    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-device-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012595    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012619    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-run-netns\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012643    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c85ab10-3394-4dc4-a3e4-7419efb552bf-konnectivity-ca\") pod \"konnectivity-agent-jzfzd\" (UID: \"4c85ab10-3394-4dc4-a3e4-7419efb552bf\") " pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012664    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-sysctl-conf\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.013367 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012674    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pz9l\" (UniqueName: \"kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l\") pod \"network-check-target-dswfb\" (UID: \"b56fcf23-ddc9-450c-bcf5-a58d5609cc25\") " pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012676    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-device-dir\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012710    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-run-netns\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012711    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-run\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012753    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-daemon-config\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.012822    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012848    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-etc-selinux\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012879    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e845702-c1e8-4dec-907a-773ed9ab8137-hosts-file\") pod \"node-resolver-d528j\" (UID: \"8e845702-c1e8-4dec-907a-773ed9ab8137\") " pod="openshift-dns/node-resolver-d528j"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012921    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8e845702-c1e8-4dec-907a-773ed9ab8137-hosts-file\") pod \"node-resolver-d528j\" (UID: \"8e845702-c1e8-4dec-907a-773ed9ab8137\") " pod="openshift-dns/node-resolver-d528j"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.012957    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs podName:26b71d0c-8000-421e-b031-4805782b9c85 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:11.51287622 +0000 UTC m=+2.102485857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs") pod "network-metrics-daemon-2jrmq" (UID: "26b71d0c-8000-421e-b031-4805782b9c85") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.012967    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-etc-selinux\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013015    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-cnibin\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013043    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7239413-938b-42bb-bad9-d4e42c0e0599-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013069    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13d06b62-8ab7-4492-b886-386083b47d5f-ovnkube-config\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013102    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-sysctl-d\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013109    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-cnibin\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013128    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-cnibin\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.014185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013186    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-cnibin\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013225    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-sysctl-d\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013268    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-var-lib-cni-multus\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013281    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4c85ab10-3394-4dc4-a3e4-7419efb552bf-konnectivity-ca\") pod \"konnectivity-agent-jzfzd\" (UID: \"4c85ab10-3394-4dc4-a3e4-7419efb552bf\") " pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013294    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fa04bf8-03bc-4b67-8bdd-014f33f75a47-host-slash\") pod \"iptables-alerter-76dw6\" (UID: \"0fa04bf8-03bc-4b67-8bdd-014f33f75a47\") " pod="openshift-network-operator/iptables-alerter-76dw6"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013315    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-var-lib-cni-multus\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013320    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-run-openvswitch\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013347    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013356    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fa04bf8-03bc-4b67-8bdd-014f33f75a47-host-slash\") pod \"iptables-alerter-76dw6\" (UID: \"0fa04bf8-03bc-4b67-8bdd-014f33f75a47\") " pod="openshift-network-operator/iptables-alerter-76dw6"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013372    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13d06b62-8ab7-4492-b886-386083b47d5f-ovnkube-script-lib\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-run-openvswitch\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013397    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-var-lib-kubelet\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013407    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013422    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-var-lib-kubelet\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013445    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-etc-kubernetes\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013465    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-var-lib-kubelet\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013472    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-os-release\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.015422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013496    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0fa04bf8-03bc-4b67-8bdd-014f33f75a47-iptables-alerter-script\") pod \"iptables-alerter-76dw6\" (UID: \"0fa04bf8-03bc-4b67-8bdd-014f33f75a47\") " pod="openshift-network-operator/iptables-alerter-76dw6"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013498    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7239413-938b-42bb-bad9-d4e42c0e0599-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013519    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-run-ovn\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013519    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-var-lib-kubelet\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013559    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-etc-kubernetes\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013570    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7239413-938b-42bb-bad9-d4e42c0e0599-os-release\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013592    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-sysconfig\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013613    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-run-ovn\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013616    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13d06b62-8ab7-4492-b886-386083b47d5f-ovnkube-config\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013619    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-lib-modules\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013658    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-sysconfig\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013677    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-run-netns\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013693    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-lib-modules\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013736    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ac7180b-8d0f-4c78-ad91-ec4104359bcc-host\") pod \"node-ca-2dmsn\" (UID: \"3ac7180b-8d0f-4c78-ad91-ec4104359bcc\") " pod="openshift-image-registry/node-ca-2dmsn"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013762    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzd46\" (UniqueName: \"kubernetes.io/projected/f7239413-938b-42bb-bad9-d4e42c0e0599-kube-api-access-gzd46\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-run-netns\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013779    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zttm\" (UniqueName: \"kubernetes.io/projected/13d06b62-8ab7-4492-b886-386083b47d5f-kube-api-access-6zttm\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013794    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-tmp\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.016246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013817    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c85ab10-3394-4dc4-a3e4-7419efb552bf-agent-certs\") pod \"konnectivity-agent-jzfzd\" (UID: \"4c85ab10-3394-4dc4-a3e4-7419efb552bf\") " pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013855    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-systemd-units\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013879    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-var-lib-openvswitch\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013906    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-socket-dir-parent\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013933    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-sys-fs\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013956    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-run-multus-certs\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013981    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e845702-c1e8-4dec-907a-773ed9ab8137-tmp-dir\") pod \"node-resolver-d528j\" (UID: \"8e845702-c1e8-4dec-907a-773ed9ab8137\") " pod="openshift-dns/node-resolver-d528j"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.013999    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13d06b62-8ab7-4492-b886-386083b47d5f-ovnkube-script-lib\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014012    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3ac7180b-8d0f-4c78-ad91-ec4104359bcc-host\") pod \"node-ca-2dmsn\" (UID: \"3ac7180b-8d0f-4c78-ad91-ec4104359bcc\") " pod="openshift-image-registry/node-ca-2dmsn"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014004    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ac7180b-8d0f-4c78-ad91-ec4104359bcc-serviceca\") pod \"node-ca-2dmsn\" (UID: \"3ac7180b-8d0f-4c78-ad91-ec4104359bcc\") " pod="openshift-image-registry/node-ca-2dmsn"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014085    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7239413-938b-42bb-bad9-d4e42c0e0599-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014097    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0fa04bf8-03bc-4b67-8bdd-014f33f75a47-iptables-alerter-script\") pod \"iptables-alerter-76dw6\" (UID: \"0fa04bf8-03bc-4b67-8bdd-014f33f75a47\") " pod="openshift-network-operator/iptables-alerter-76dw6"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014132    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-run-systemd\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014159    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-cni-bin\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014172    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-multus-socket-dir-parent\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014181    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-sys\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014217    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-host\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014238    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-os-release\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.017095 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014262    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-cni-binary-copy\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014384    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3ac7180b-8d0f-4c78-ad91-ec4104359bcc-serviceca\") pod \"node-ca-2dmsn\" (UID: \"3ac7180b-8d0f-4c78-ad91-ec4104359bcc\") " pod="openshift-image-registry/node-ca-2dmsn"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014402    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-host-cni-bin\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014623    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-host-run-multus-certs\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014683    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c0589b10-d76a-415e-a5a5-90d769094542-sys-fs\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014751    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-systemd-units\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014798    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-var-lib-openvswitch\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014876    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13d06b62-8ab7-4492-b886-386083b47d5f-run-systemd\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014881    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7239413-938b-42bb-bad9-d4e42c0e0599-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014875    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e845702-c1e8-4dec-907a-773ed9ab8137-tmp-dir\") pod \"node-resolver-d528j\" (UID: \"8e845702-c1e8-4dec-907a-773ed9ab8137\") " pod="openshift-dns/node-resolver-d528j"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014940    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-os-release\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014938    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-host\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.014982    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-sys\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.015006    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-etc-tuned\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.015044    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-cni-binary-copy\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.015128    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13d06b62-8ab7-4492-b886-386083b47d5f-ovn-node-metrics-cert\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.016137    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-tmp\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.017985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.016183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4c85ab10-3394-4dc4-a3e4-7419efb552bf-agent-certs\") pod \"konnectivity-agent-jzfzd\" (UID: \"4c85ab10-3394-4dc4-a3e4-7419efb552bf\") " pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:11.023579 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.023556    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:11.023682 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.023586    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:11.023682 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.023599    2562 projected.go:194] Error preparing data for projected volume kube-api-access-6pz9l for pod openshift-network-diagnostics/network-check-target-dswfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:11.023682 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.023651    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l podName:b56fcf23-ddc9-450c-bcf5-a58d5609cc25 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:11.52363643 +0000 UTC m=+2.113246068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6pz9l" (UniqueName: "kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l") pod "network-check-target-dswfb" (UID: "b56fcf23-ddc9-450c-bcf5-a58d5609cc25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:11.025233 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.025208    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25vbp\" (UniqueName: \"kubernetes.io/projected/c0589b10-d76a-415e-a5a5-90d769094542-kube-api-access-25vbp\") pod \"aws-ebs-csi-driver-node-n5lnj\" (UID: \"c0589b10-d76a-415e-a5a5-90d769094542\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.025325 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.025247    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zttm\" (UniqueName: \"kubernetes.io/projected/13d06b62-8ab7-4492-b886-386083b47d5f-kube-api-access-6zttm\") pod \"ovnkube-node-x67nm\" (UID: \"13d06b62-8ab7-4492-b886-386083b47d5f\") " pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.025605 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.025587    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxcjs\" (UniqueName: \"kubernetes.io/projected/0fa04bf8-03bc-4b67-8bdd-014f33f75a47-kube-api-access-nxcjs\") pod \"iptables-alerter-76dw6\" (UID: \"0fa04bf8-03bc-4b67-8bdd-014f33f75a47\") " pod="openshift-network-operator/iptables-alerter-76dw6"
May 28 18:26:11.025815 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.025794    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl94v\" (UniqueName: \"kubernetes.io/projected/5a89bec3-1c9d-40f3-af16-a7eda65e3fa6-kube-api-access-hl94v\") pod \"tuned-g9drr\" (UID: \"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6\") " pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.026175 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.026146    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vf58\" (UniqueName: \"kubernetes.io/projected/3ac7180b-8d0f-4c78-ad91-ec4104359bcc-kube-api-access-5vf58\") pod \"node-ca-2dmsn\" (UID: \"3ac7180b-8d0f-4c78-ad91-ec4104359bcc\") " pod="openshift-image-registry/node-ca-2dmsn"
May 28 18:26:11.026259 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.026240    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzd46\" (UniqueName: \"kubernetes.io/projected/f7239413-938b-42bb-bad9-d4e42c0e0599-kube-api-access-gzd46\") pod \"multus-additional-cni-plugins-z4ghf\" (UID: \"f7239413-938b-42bb-bad9-d4e42c0e0599\") " pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.026473 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.026453    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvfz6\" (UniqueName: \"kubernetes.io/projected/26b71d0c-8000-421e-b031-4805782b9c85-kube-api-access-gvfz6\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:11.026646 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.026627    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4dc7\" (UniqueName: \"kubernetes.io/projected/8e845702-c1e8-4dec-907a-773ed9ab8137-kube-api-access-h4dc7\") pod \"node-resolver-d528j\" (UID: \"8e845702-c1e8-4dec-907a-773ed9ab8137\") " pod="openshift-dns/node-resolver-d528j"
May 28 18:26:11.027232 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.027212    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhqb8\" (UniqueName: \"kubernetes.io/projected/2ad0402a-5df5-43f0-bb52-3a5a93cf47f1-kube-api-access-hhqb8\") pod \"multus-n5lrf\" (UID: \"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1\") " pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.217239 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.217163    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2dmsn"
May 28 18:26:11.221783 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.221763    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4ghf"
May 28 18:26:11.223605 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:11.223579    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac7180b_8d0f_4c78_ad91_ec4104359bcc.slice/crio-2b7e1208635b80a2a977c9e1b48c74144f316b5e2d875ac28af35825cf1ad1ac WatchSource:0}: Error finding container 2b7e1208635b80a2a977c9e1b48c74144f316b5e2d875ac28af35825cf1ad1ac: Status 404 returned error can't find the container with id 2b7e1208635b80a2a977c9e1b48c74144f316b5e2d875ac28af35825cf1ad1ac
May 28 18:26:11.228200 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:11.228176    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7239413_938b_42bb_bad9_d4e42c0e0599.slice/crio-0a729a5ea6bad824c627f8623ca544a94f52c3b691f7264993231897d84b6b28 WatchSource:0}: Error finding container 0a729a5ea6bad824c627f8623ca544a94f52c3b691f7264993231897d84b6b28: Status 404 returned error can't find the container with id 0a729a5ea6bad824c627f8623ca544a94f52c3b691f7264993231897d84b6b28
May 28 18:26:11.236477 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.236461    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n5lrf"
May 28 18:26:11.242119 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:11.242098    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad0402a_5df5_43f0_bb52_3a5a93cf47f1.slice/crio-195dd295ff5ecea6a18f34dc3e013088a35e2f8caf7c92bdbc0d07dadb592db5 WatchSource:0}: Error finding container 195dd295ff5ecea6a18f34dc3e013088a35e2f8caf7c92bdbc0d07dadb592db5: Status 404 returned error can't find the container with id 195dd295ff5ecea6a18f34dc3e013088a35e2f8caf7c92bdbc0d07dadb592db5
May 28 18:26:11.251410 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.251391    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:11.257166 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:11.257025    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c85ab10_3394_4dc4_a3e4_7419efb552bf.slice/crio-aff7c998e22359c89edeeff954b16cd474f268a825d5327fa1a11fb7b743e8ca WatchSource:0}: Error finding container aff7c998e22359c89edeeff954b16cd474f268a825d5327fa1a11fb7b743e8ca: Status 404 returned error can't find the container with id aff7c998e22359c89edeeff954b16cd474f268a825d5327fa1a11fb7b743e8ca
May 28 18:26:11.281558 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.281534    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj"
May 28 18:26:11.286291 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.286269    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-76dw6"
May 28 18:26:11.286482 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:11.286463    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0589b10_d76a_415e_a5a5_90d769094542.slice/crio-1fd5d1ea04dd50c0dea9aa74f737e1af85fe64a2162d91ebf6bbf57ec647a37e WatchSource:0}: Error finding container 1fd5d1ea04dd50c0dea9aa74f737e1af85fe64a2162d91ebf6bbf57ec647a37e: Status 404 returned error can't find the container with id 1fd5d1ea04dd50c0dea9aa74f737e1af85fe64a2162d91ebf6bbf57ec647a37e
May 28 18:26:11.292064 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.292043    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:11.292388 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:11.292352    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa04bf8_03bc_4b67_8bdd_014f33f75a47.slice/crio-7a826eb501af1bfffbfcb0e2cc6ea4ba66a0bc5fc2e4bfc1b3e2d726335bb2fe WatchSource:0}: Error finding container 7a826eb501af1bfffbfcb0e2cc6ea4ba66a0bc5fc2e4bfc1b3e2d726335bb2fe: Status 404 returned error can't find the container with id 7a826eb501af1bfffbfcb0e2cc6ea4ba66a0bc5fc2e4bfc1b3e2d726335bb2fe
May 28 18:26:11.297785 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:11.297763    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d06b62_8ab7_4492_b886_386083b47d5f.slice/crio-2fb87e6a3dc0800628b6f3f83f6070ff6b12068a335dc8bf845c7a0d81e877c4 WatchSource:0}: Error finding container 2fb87e6a3dc0800628b6f3f83f6070ff6b12068a335dc8bf845c7a0d81e877c4: Status 404 returned error can't find the container with id 2fb87e6a3dc0800628b6f3f83f6070ff6b12068a335dc8bf845c7a0d81e877c4
May 28 18:26:11.297878 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.297802    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g9drr"
May 28 18:26:11.302115 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.302096    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d528j"
May 28 18:26:11.303866 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:11.303841    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a89bec3_1c9d_40f3_af16_a7eda65e3fa6.slice/crio-fbfd4253d8633018e2bcde56291abf16f087f5bf00391784288baab3649bdd5c WatchSource:0}: Error finding container fbfd4253d8633018e2bcde56291abf16f087f5bf00391784288baab3649bdd5c: Status 404 returned error can't find the container with id fbfd4253d8633018e2bcde56291abf16f087f5bf00391784288baab3649bdd5c
May 28 18:26:11.310233 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:11.310196    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e845702_c1e8_4dec_907a_773ed9ab8137.slice/crio-06a89c850ebde83cbde7098d05f89bca9c823b2e022b3aeef53caf4f4ea11425 WatchSource:0}: Error finding container 06a89c850ebde83cbde7098d05f89bca9c823b2e022b3aeef53caf4f4ea11425: Status 404 returned error can't find the container with id 06a89c850ebde83cbde7098d05f89bca9c823b2e022b3aeef53caf4f4ea11425
May 28 18:26:11.517696 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.517200    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:11.517696 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.517366    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:11.517696 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.517434    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs podName:26b71d0c-8000-421e-b031-4805782b9c85 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:12.517415015 +0000 UTC m=+3.107024640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs") pod "network-metrics-daemon-2jrmq" (UID: "26b71d0c-8000-421e-b031-4805782b9c85") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:11.609501 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.609470    2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:26:11.618663 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.618599    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pz9l\" (UniqueName: \"kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l\") pod \"network-check-target-dswfb\" (UID: \"b56fcf23-ddc9-450c-bcf5-a58d5609cc25\") " pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:11.618866 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.618783    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:11.618866 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.618812    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:11.618866 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.618849    2562 projected.go:194] Error preparing data for projected volume kube-api-access-6pz9l for pod openshift-network-diagnostics/network-check-target-dswfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:11.619027 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:11.618907    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l podName:b56fcf23-ddc9-450c-bcf5-a58d5609cc25 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:12.618887614 +0000 UTC m=+3.208497234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pz9l" (UniqueName: "kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l") pod "network-check-target-dswfb" (UID: "b56fcf23-ddc9-450c-bcf5-a58d5609cc25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:11.941604 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.941440    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:21:10 +0000 UTC" deadline="2027-11-27 13:10:17.233242133 +0000 UTC"
May 28 18:26:11.941604 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:11.941480    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13146h44m5.291766116s"
May 28 18:26:12.029079 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.028364    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g9drr" event={"ID":"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6","Type":"ContainerStarted","Data":"fbfd4253d8633018e2bcde56291abf16f087f5bf00391784288baab3649bdd5c"}
May 28 18:26:12.038346 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.038251    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n5lrf" event={"ID":"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1","Type":"ContainerStarted","Data":"195dd295ff5ecea6a18f34dc3e013088a35e2f8caf7c92bdbc0d07dadb592db5"}
May 28 18:26:12.046027 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.044290    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d528j" event={"ID":"8e845702-c1e8-4dec-907a-773ed9ab8137","Type":"ContainerStarted","Data":"06a89c850ebde83cbde7098d05f89bca9c823b2e022b3aeef53caf4f4ea11425"}
May 28 18:26:12.046204 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.046035    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm" event={"ID":"13d06b62-8ab7-4492-b886-386083b47d5f","Type":"ContainerStarted","Data":"2fb87e6a3dc0800628b6f3f83f6070ff6b12068a335dc8bf845c7a0d81e877c4"}
May 28 18:26:12.054061 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.054027    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-76dw6" event={"ID":"0fa04bf8-03bc-4b67-8bdd-014f33f75a47","Type":"ContainerStarted","Data":"7a826eb501af1bfffbfcb0e2cc6ea4ba66a0bc5fc2e4bfc1b3e2d726335bb2fe"}
May 28 18:26:12.060783 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.060747    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj" event={"ID":"c0589b10-d76a-415e-a5a5-90d769094542","Type":"ContainerStarted","Data":"1fd5d1ea04dd50c0dea9aa74f737e1af85fe64a2162d91ebf6bbf57ec647a37e"}
May 28 18:26:12.066487 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.066451    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jzfzd" event={"ID":"4c85ab10-3394-4dc4-a3e4-7419efb552bf","Type":"ContainerStarted","Data":"aff7c998e22359c89edeeff954b16cd474f268a825d5327fa1a11fb7b743e8ca"}
May 28 18:26:12.082906 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.079229    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4ghf" event={"ID":"f7239413-938b-42bb-bad9-d4e42c0e0599","Type":"ContainerStarted","Data":"0a729a5ea6bad824c627f8623ca544a94f52c3b691f7264993231897d84b6b28"}
May 28 18:26:12.087067 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.087029    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2dmsn" event={"ID":"3ac7180b-8d0f-4c78-ad91-ec4104359bcc","Type":"ContainerStarted","Data":"2b7e1208635b80a2a977c9e1b48c74144f316b5e2d875ac28af35825cf1ad1ac"}
May 28 18:26:12.386256 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.386176    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:26:12.526356 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.526321    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:12.526525 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:12.526475    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:12.526600 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:12.526537    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs podName:26b71d0c-8000-421e-b031-4805782b9c85 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:14.526516095 +0000 UTC m=+5.116125719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs") pod "network-metrics-daemon-2jrmq" (UID: "26b71d0c-8000-421e-b031-4805782b9c85") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:12.627839 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.627805    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pz9l\" (UniqueName: \"kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l\") pod \"network-check-target-dswfb\" (UID: \"b56fcf23-ddc9-450c-bcf5-a58d5609cc25\") " pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:12.628017 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:12.627978    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:12.628017 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:12.627997    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:12.628017 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:12.628010    2562 projected.go:194] Error preparing data for projected volume kube-api-access-6pz9l for pod openshift-network-diagnostics/network-check-target-dswfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:12.628174 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:12.628067    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l podName:b56fcf23-ddc9-450c-bcf5-a58d5609cc25 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:14.628047573 +0000 UTC m=+5.217657195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pz9l" (UniqueName: "kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l") pod "network-check-target-dswfb" (UID: "b56fcf23-ddc9-450c-bcf5-a58d5609cc25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:12.942301 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.942232    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:21:10 +0000 UTC" deadline="2027-11-27 01:40:40.438191073 +0000 UTC"
May 28 18:26:12.942301 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:12.942267    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13135h14m27.495929428s"
May 28 18:26:13.007649 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:13.007597    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:13.007848 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:13.007742    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:13.008171 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:13.008029    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:13.008171 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:13.008131    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:14.545261 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:14.544684    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:14.545261 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:14.544886    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:14.545261 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:14.544953    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs podName:26b71d0c-8000-421e-b031-4805782b9c85 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:18.544933895 +0000 UTC m=+9.134543529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs") pod "network-metrics-daemon-2jrmq" (UID: "26b71d0c-8000-421e-b031-4805782b9c85") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:14.645479 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:14.645398    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pz9l\" (UniqueName: \"kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l\") pod \"network-check-target-dswfb\" (UID: \"b56fcf23-ddc9-450c-bcf5-a58d5609cc25\") " pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:14.645655 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:14.645578    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:14.645655 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:14.645604    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:14.645655 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:14.645617    2562 projected.go:194] Error preparing data for projected volume kube-api-access-6pz9l for pod openshift-network-diagnostics/network-check-target-dswfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:14.645839 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:14.645684    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l podName:b56fcf23-ddc9-450c-bcf5-a58d5609cc25 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:18.645664322 +0000 UTC m=+9.235273960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pz9l" (UniqueName: "kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l") pod "network-check-target-dswfb" (UID: "b56fcf23-ddc9-450c-bcf5-a58d5609cc25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:15.007627 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:15.007547    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:15.007627 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:15.007604    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:15.007865 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:15.007702    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:15.008219 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:15.008160    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:17.007819 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:17.007774    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:17.008271 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:17.007913    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:17.008271 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:17.007977    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:17.008271 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:17.008098    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:18.580338 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:18.580304    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:18.580804 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:18.580502    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:18.580804 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:18.580569    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs podName:26b71d0c-8000-421e-b031-4805782b9c85 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:26.580548844 +0000 UTC m=+17.170158481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs") pod "network-metrics-daemon-2jrmq" (UID: "26b71d0c-8000-421e-b031-4805782b9c85") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:18.681430 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:18.681266    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pz9l\" (UniqueName: \"kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l\") pod \"network-check-target-dswfb\" (UID: \"b56fcf23-ddc9-450c-bcf5-a58d5609cc25\") " pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:18.681609 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:18.681453    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:18.681609 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:18.681474    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:18.681609 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:18.681488    2562 projected.go:194] Error preparing data for projected volume kube-api-access-6pz9l for pod openshift-network-diagnostics/network-check-target-dswfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:18.681609 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:18.681553    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l podName:b56fcf23-ddc9-450c-bcf5-a58d5609cc25 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:26.681533186 +0000 UTC m=+17.271142807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pz9l" (UniqueName: "kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l") pod "network-check-target-dswfb" (UID: "b56fcf23-ddc9-450c-bcf5-a58d5609cc25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:19.008067 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:19.007990    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:19.008226 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:19.007990    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:19.008226 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:19.008115    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:19.008226 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:19.008208    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:21.008130 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:21.008093    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:21.008565 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:21.008211    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:21.008565 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:21.008271    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:21.008565 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:21.008390    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:23.007392 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:23.007356    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:23.007865 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:23.007356    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:23.007865 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:23.007495    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:23.007865 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:23.007550    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:25.007463 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:25.007426    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:25.007463 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:25.007447    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:25.007954 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:25.007531    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:25.007954 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:25.007672    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:26.640380 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:26.640349    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:26.640840 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:26.640458    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:26.640840 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:26.640510    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs podName:26b71d0c-8000-421e-b031-4805782b9c85 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:42.640494759 +0000 UTC m=+33.230104395 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs") pod "network-metrics-daemon-2jrmq" (UID: "26b71d0c-8000-421e-b031-4805782b9c85") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:26.741039 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:26.740916    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pz9l\" (UniqueName: \"kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l\") pod \"network-check-target-dswfb\" (UID: \"b56fcf23-ddc9-450c-bcf5-a58d5609cc25\") " pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:26.741197 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:26.741068    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:26.741197 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:26.741088    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:26.741197 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:26.741102    2562 projected.go:194] Error preparing data for projected volume kube-api-access-6pz9l for pod openshift-network-diagnostics/network-check-target-dswfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:26.741197 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:26.741168    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l podName:b56fcf23-ddc9-450c-bcf5-a58d5609cc25 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:42.741147802 +0000 UTC m=+33.330757436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pz9l" (UniqueName: "kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l") pod "network-check-target-dswfb" (UID: "b56fcf23-ddc9-450c-bcf5-a58d5609cc25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:27.007829 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:27.007640    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:27.007829 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:27.007676    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:27.007829 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:27.007805    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:27.008071 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:27.007910    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:29.008184 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:29.008149    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:29.008670 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:29.008149    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:29.008670 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:29.008269    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:29.008670 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:29.008400    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:30.127512 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:30.127330    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g9drr" event={"ID":"5a89bec3-1c9d-40f3-af16-a7eda65e3fa6","Type":"ContainerStarted","Data":"f9e1a50c71a22ebef50198c65b3af37ad9114a1739d15da8297e25bc38fa919d"}
May 28 18:26:30.129388 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:30.129355    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-216.ec2.internal" event={"ID":"ac25bcb2d036809e2b2845a0da4269f7","Type":"ContainerStarted","Data":"2f6be62b97de62e9e67f0010d263e801239ed28c9df7b6a29d8013ee7ec09bbb"}
May 28 18:26:30.131016 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:30.130996    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm" event={"ID":"13d06b62-8ab7-4492-b886-386083b47d5f","Type":"ContainerStarted","Data":"9fb03c9d18f713988f1ac4b7e81dee56a3af884d6319e59c0ab952a10b161163"}
May 28 18:26:30.147282 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:30.147231    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g9drr" podStartSLOduration=1.6184045 podStartE2EDuration="20.147213389s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="2026-05-28 18:26:11.305770372 +0000 UTC m=+1.895379997" lastFinishedPulling="2026-05-28 18:26:29.834579265 +0000 UTC m=+20.424188886" observedRunningTime="2026-05-28 18:26:30.146571975 +0000 UTC m=+20.736181615" watchObservedRunningTime="2026-05-28 18:26:30.147213389 +0000 UTC m=+20.736823031"
May 28 18:26:30.162115 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:30.162074    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-216.ec2.internal" podStartSLOduration=20.162060644 podStartE2EDuration="20.162060644s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:26:30.161541847 +0000 UTC m=+20.751151488" watchObservedRunningTime="2026-05-28 18:26:30.162060644 +0000 UTC m=+20.751670284"
May 28 18:26:31.007332 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.007158    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:31.007489 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.007159    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:31.007489 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:31.007405    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:31.007585 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:31.007494    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:31.134304 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.134210    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-76dw6" event={"ID":"0fa04bf8-03bc-4b67-8bdd-014f33f75a47","Type":"ContainerStarted","Data":"4b10000458a02d83eb8a7897ccbce71610a5d457e66f1335dffe304a6cf49827"}
May 28 18:26:31.135782 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.135757    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj" event={"ID":"c0589b10-d76a-415e-a5a5-90d769094542","Type":"ContainerStarted","Data":"f2b3869f99bde1dc668cd184fe848fbdd75f76cbb3a137ad731baf2dc2c33681"}
May 28 18:26:31.137091 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.137056    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jzfzd" event={"ID":"4c85ab10-3394-4dc4-a3e4-7419efb552bf","Type":"ContainerStarted","Data":"c648ed93d3e07ba090516ec0a1fdf7446f2afea7f94fd724e25d13dca7ba3435"}
May 28 18:26:31.138814 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.138788    2562 generic.go:358] "Generic (PLEG): container finished" podID="f7239413-938b-42bb-bad9-d4e42c0e0599" containerID="3fcb3e4b8c7dbb28cf828a7548aad09881be8dc868d0e1c085edfa64534cc5b4" exitCode=0
May 28 18:26:31.138930 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.138871    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4ghf" event={"ID":"f7239413-938b-42bb-bad9-d4e42c0e0599","Type":"ContainerDied","Data":"3fcb3e4b8c7dbb28cf828a7548aad09881be8dc868d0e1c085edfa64534cc5b4"}
May 28 18:26:31.140384 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.140361    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2dmsn" event={"ID":"3ac7180b-8d0f-4c78-ad91-ec4104359bcc","Type":"ContainerStarted","Data":"697451a8ba7637cb5cfc02581560398d9b6f7ff740c7de28ed5e9c3c1195378b"}
May 28 18:26:31.141883 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.141857    2562 generic.go:358] "Generic (PLEG): container finished" podID="2732cb86a6a883be1f4da26c8fe222aa" containerID="63670b8a4dfc4e8a62e53e252e947e5771c8778a190fd0d60cbdab82fdd61b10" exitCode=0
May 28 18:26:31.141967 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.141932    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal" event={"ID":"2732cb86a6a883be1f4da26c8fe222aa","Type":"ContainerDied","Data":"63670b8a4dfc4e8a62e53e252e947e5771c8778a190fd0d60cbdab82fdd61b10"}
May 28 18:26:31.143421 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.143390    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n5lrf" event={"ID":"2ad0402a-5df5-43f0-bb52-3a5a93cf47f1","Type":"ContainerStarted","Data":"5a843e676813bae3a622da8880e4f9b82ba6a8cc5687a36183157bfb7af356c0"}
May 28 18:26:31.144773 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.144750    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d528j" event={"ID":"8e845702-c1e8-4dec-907a-773ed9ab8137","Type":"ContainerStarted","Data":"963103f4651118b102f4a50e1c1b046f85373134d00bf19f5ce141bae8aaaab6"}
May 28 18:26:31.147483 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.147463    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:26:31.147806 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.147788    2562 generic.go:358] "Generic (PLEG): container finished" podID="13d06b62-8ab7-4492-b886-386083b47d5f" containerID="f7b518b6699cc1aa355affe0fe555803f890ecf9ac30e1da2ba0999c78bb2517" exitCode=1
May 28 18:26:31.147896 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.147855    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm" event={"ID":"13d06b62-8ab7-4492-b886-386083b47d5f","Type":"ContainerStarted","Data":"7f3220890ef67d8effd162729dbf733ec80e9597a6ad5bc88db69678c09e26da"}
May 28 18:26:31.147896 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.147879    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm" event={"ID":"13d06b62-8ab7-4492-b886-386083b47d5f","Type":"ContainerStarted","Data":"e0c84412f602bbb6591b63e4ca58406f358f26e3685741190ab9a3be43929ca4"}
May 28 18:26:31.147896 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.147893    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm" event={"ID":"13d06b62-8ab7-4492-b886-386083b47d5f","Type":"ContainerStarted","Data":"82bde75f01b7ad1f399fa3c03275a953825d55dc1dda3005bbe00add93060f3a"}
May 28 18:26:31.148039 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.147906    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm" event={"ID":"13d06b62-8ab7-4492-b886-386083b47d5f","Type":"ContainerStarted","Data":"b8d1615ca5ee0a601a10e60fe41cfdde5d821c8b755b1f0f161f625d05c10353"}
May 28 18:26:31.148039 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.147919    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm" event={"ID":"13d06b62-8ab7-4492-b886-386083b47d5f","Type":"ContainerDied","Data":"f7b518b6699cc1aa355affe0fe555803f890ecf9ac30e1da2ba0999c78bb2517"}
May 28 18:26:31.152524 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.152476    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-76dw6" podStartSLOduration=2.659969484 podStartE2EDuration="21.15246139s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="2026-05-28 18:26:11.293589316 +0000 UTC m=+1.883198935" lastFinishedPulling="2026-05-28 18:26:29.786081207 +0000 UTC m=+20.375690841" observedRunningTime="2026-05-28 18:26:31.151937706 +0000 UTC m=+21.741547346" watchObservedRunningTime="2026-05-28 18:26:31.15246139 +0000 UTC m=+21.742071046"
May 28 18:26:31.198607 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.198552    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-d528j" podStartSLOduration=2.675430192 podStartE2EDuration="21.198534983s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="2026-05-28 18:26:11.312079275 +0000 UTC m=+1.901688896" lastFinishedPulling="2026-05-28 18:26:29.835184053 +0000 UTC m=+20.424793687" observedRunningTime="2026-05-28 18:26:31.197735376 +0000 UTC m=+21.787345025" watchObservedRunningTime="2026-05-28 18:26:31.198534983 +0000 UTC m=+21.788144625"
May 28 18:26:31.198701 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.198660    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2dmsn" podStartSLOduration=7.368329535 podStartE2EDuration="21.19865268s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="2026-05-28 18:26:11.225296819 +0000 UTC m=+1.814906438" lastFinishedPulling="2026-05-28 18:26:25.055619964 +0000 UTC m=+15.645229583" observedRunningTime="2026-05-28 18:26:31.180445704 +0000 UTC m=+21.770055345" watchObservedRunningTime="2026-05-28 18:26:31.19865268 +0000 UTC m=+21.788262322"
May 28 18:26:31.260063 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.259686    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-n5lrf" podStartSLOduration=2.254920287 podStartE2EDuration="21.259669143s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="2026-05-28 18:26:11.243816496 +0000 UTC m=+1.833426114" lastFinishedPulling="2026-05-28 18:26:30.248565337 +0000 UTC m=+20.838174970" observedRunningTime="2026-05-28 18:26:31.258826476 +0000 UTC m=+21.848436118" watchObservedRunningTime="2026-05-28 18:26:31.259669143 +0000 UTC m=+21.849278785"
May 28 18:26:31.282848 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.282752    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jzfzd" podStartSLOduration=2.726456299 podStartE2EDuration="21.282734789s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="2026-05-28 18:26:11.258281253 +0000 UTC m=+1.847890871" lastFinishedPulling="2026-05-28 18:26:29.814559739 +0000 UTC m=+20.404169361" observedRunningTime="2026-05-28 18:26:31.282696878 +0000 UTC m=+21.872306520" watchObservedRunningTime="2026-05-28 18:26:31.282734789 +0000 UTC m=+21.872344423"
May 28 18:26:31.350931 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.350911    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 18:26:31.979825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.979630    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T18:26:31.350927735Z","UUID":"09b59b11-8f09-44c7-b97a-696b185ca0f9","Handler":null,"Name":"","Endpoint":""}
May 28 18:26:31.983195 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.983168    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 18:26:31.983350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:31.983207    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 18:26:32.151121 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:32.151087    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal" event={"ID":"2732cb86a6a883be1f4da26c8fe222aa","Type":"ContainerStarted","Data":"9fc193996202053c3a651226564b5999673a8fbe9b22db259d0cca4b0d4dad57"}
May 28 18:26:32.152925 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:32.152869    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj" event={"ID":"c0589b10-d76a-415e-a5a5-90d769094542","Type":"ContainerStarted","Data":"51c59fef525968df6370bb768da6d91c7d089d406aec5003046bdd92ee0f7a03"}
May 28 18:26:32.168064 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:32.168021    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-216.ec2.internal" podStartSLOduration=22.16800873 podStartE2EDuration="22.16800873s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:26:32.167543344 +0000 UTC m=+22.757152989" watchObservedRunningTime="2026-05-28 18:26:32.16800873 +0000 UTC m=+22.757618370"
May 28 18:26:33.008240 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:33.008205    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:33.008427 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:33.008322    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:33.008427 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:33.008378    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:33.008615 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:33.008444    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:33.158070 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:33.158044    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:26:33.158506 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:33.158422    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm" event={"ID":"13d06b62-8ab7-4492-b886-386083b47d5f","Type":"ContainerStarted","Data":"6234749a3546e4b3b62353b008a9b199ff03637c304951d062c913aa3dcf3eb1"}
May 28 18:26:33.160601 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:33.160573    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj" event={"ID":"c0589b10-d76a-415e-a5a5-90d769094542","Type":"ContainerStarted","Data":"5e6331c4184318069d30b410f93a635a77ff00d07d2dfd4970e8de399d847492"}
May 28 18:26:33.178405 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:33.178356    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n5lnj" podStartSLOduration=2.150300873 podStartE2EDuration="23.178340096s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="2026-05-28 18:26:11.288828871 +0000 UTC m=+1.878438490" lastFinishedPulling="2026-05-28 18:26:32.316868088 +0000 UTC m=+22.906477713" observedRunningTime="2026-05-28 18:26:33.177969947 +0000 UTC m=+23.767579591" watchObservedRunningTime="2026-05-28 18:26:33.178340096 +0000 UTC m=+23.767949738"
May 28 18:26:34.464646 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:34.464609    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:34.466307 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:34.466286    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:35.007384 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:35.007341    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:35.007559 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:35.007478    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:35.007559 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:35.007509    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:35.007652 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:35.007612    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:35.167360 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:35.167224    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:26:35.167788 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:35.167754    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm" event={"ID":"13d06b62-8ab7-4492-b886-386083b47d5f","Type":"ContainerStarted","Data":"6382b03af042064abf20ab1b80e877e109f1273984a6649670dd061f90accbbc"}
May 28 18:26:36.170495 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:36.170463    2562 generic.go:358] "Generic (PLEG): container finished" podID="f7239413-938b-42bb-bad9-d4e42c0e0599" containerID="e7ca4ebb77495b499b876d7f08c1e44afae9e2dc34d6334e52176f5f4fc2bbbd" exitCode=0
May 28 18:26:36.171182 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:36.170545    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4ghf" event={"ID":"f7239413-938b-42bb-bad9-d4e42c0e0599","Type":"ContainerDied","Data":"e7ca4ebb77495b499b876d7f08c1e44afae9e2dc34d6334e52176f5f4fc2bbbd"}
May 28 18:26:36.171182 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:36.170842    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:36.171182 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:36.170868    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:36.171182 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:36.171013    2562 scope.go:117] "RemoveContainer" containerID="f7b518b6699cc1aa355affe0fe555803f890ecf9ac30e1da2ba0999c78bb2517"
May 28 18:26:36.188084 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:36.188061    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:37.007743 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.007489    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:37.007743 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.007489    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:37.007966 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:37.007782    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:37.007966 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:37.007823    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:37.087762 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.087711    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dswfb"]
May 28 18:26:37.090310 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.090286    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jrmq"]
May 28 18:26:37.175353 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.175327    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:26:37.175771 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.175675    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm" event={"ID":"13d06b62-8ab7-4492-b886-386083b47d5f","Type":"ContainerStarted","Data":"fa7b60be99d2ac04362e44474f5ebb74bb3e471b35145c4e53696e3ca97ce353"}
May 28 18:26:37.175952 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.175934    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:37.177451 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.177429    2562 generic.go:358] "Generic (PLEG): container finished" podID="f7239413-938b-42bb-bad9-d4e42c0e0599" containerID="206ac9d2195640ea2a26fe77a4dfbd88574d427df743f24384661ee16aed41a9" exitCode=0
May 28 18:26:37.177558 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.177490    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4ghf" event={"ID":"f7239413-938b-42bb-bad9-d4e42c0e0599","Type":"ContainerDied","Data":"206ac9d2195640ea2a26fe77a4dfbd88574d427df743f24384661ee16aed41a9"}
May 28 18:26:37.177558 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.177531    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:37.177674 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.177657    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:37.177792 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:37.177776    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:37.177928 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:37.177909    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:37.192622 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.192600    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:26:37.200788 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.200745    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm" podStartSLOduration=8.622048268 podStartE2EDuration="27.20070832s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="2026-05-28 18:26:11.299324947 +0000 UTC m=+1.888934574" lastFinishedPulling="2026-05-28 18:26:29.877985003 +0000 UTC m=+20.467594626" observedRunningTime="2026-05-28 18:26:37.200135233 +0000 UTC m=+27.789744873" watchObservedRunningTime="2026-05-28 18:26:37.20070832 +0000 UTC m=+27.790317960"
May 28 18:26:37.360273 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.360191    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:37.360408 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.360339    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 28 18:26:37.360879 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:37.360862    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jzfzd"
May 28 18:26:38.183819 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:38.183715    2562 generic.go:358] "Generic (PLEG): container finished" podID="f7239413-938b-42bb-bad9-d4e42c0e0599" containerID="b5923ccc9f3ed43109e9b43df26b22df509c1a7c17fae0c74dc328b02018e0aa" exitCode=0
May 28 18:26:38.183819 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:38.183794    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4ghf" event={"ID":"f7239413-938b-42bb-bad9-d4e42c0e0599","Type":"ContainerDied","Data":"b5923ccc9f3ed43109e9b43df26b22df509c1a7c17fae0c74dc328b02018e0aa"}
May 28 18:26:39.008068 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:39.007995    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:39.008068 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:39.008042    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:39.008254 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:39.008124    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:39.008399 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:39.008373    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:41.007242 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:41.007202    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:41.007242 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:41.007240    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:41.007974 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:41.007338    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:41.007974 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:41.007453    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:42.659512 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:42.659470    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:42.660137 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:42.659586    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:42.660137 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:42.659669    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs podName:26b71d0c-8000-421e-b031-4805782b9c85 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:14.659650422 +0000 UTC m=+65.249260043 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs") pod "network-metrics-daemon-2jrmq" (UID: "26b71d0c-8000-421e-b031-4805782b9c85") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:42.760139 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:42.760103    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pz9l\" (UniqueName: \"kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l\") pod \"network-check-target-dswfb\" (UID: \"b56fcf23-ddc9-450c-bcf5-a58d5609cc25\") " pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:42.760331 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:42.760287    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:42.760331 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:42.760311    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:42.760331 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:42.760323    2562 projected.go:194] Error preparing data for projected volume kube-api-access-6pz9l for pod openshift-network-diagnostics/network-check-target-dswfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:42.760493 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:42.760392    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l podName:b56fcf23-ddc9-450c-bcf5-a58d5609cc25 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:14.760372707 +0000 UTC m=+65.349982330 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6pz9l" (UniqueName: "kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l") pod "network-check-target-dswfb" (UID: "b56fcf23-ddc9-450c-bcf5-a58d5609cc25") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:42.805090 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:42.805055    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4xtns"]
May 28 18:26:42.839374 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:42.839333    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4xtns"]
May 28 18:26:42.839541 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:42.839493    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:42.839598 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:42.839571    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4xtns" podUID="f6f8994e-61a4-470b-874e-11d108500743"
May 28 18:26:42.961882 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:42.961843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:42.962069 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:42.961980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6f8994e-61a4-470b-874e-11d108500743-kubelet-config\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:42.962069 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:42.962040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6f8994e-61a4-470b-874e-11d108500743-dbus\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:43.007330 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.007291    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:43.007330 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.007314    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:43.007562 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.007422    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dswfb" podUID="b56fcf23-ddc9-450c-bcf5-a58d5609cc25"
May 28 18:26:43.007562 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.007533    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2jrmq" podUID="26b71d0c-8000-421e-b031-4805782b9c85"
May 28 18:26:43.062566 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.062531    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6f8994e-61a4-470b-874e-11d108500743-dbus\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:43.062566 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.062572    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:43.062800 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.062651    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6f8994e-61a4-470b-874e-11d108500743-kubelet-config\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:43.062800 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.062743    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f6f8994e-61a4-470b-874e-11d108500743-kubelet-config\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:43.062920 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.062790    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:43.062920 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.062829    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f6f8994e-61a4-470b-874e-11d108500743-dbus\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:43.062920 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.062875    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret podName:f6f8994e-61a4-470b-874e-11d108500743 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:43.562853875 +0000 UTC m=+34.152463510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret") pod "global-pull-secret-syncer-4xtns" (UID: "f6f8994e-61a4-470b-874e-11d108500743") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:43.202227 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.202197    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-216.ec2.internal" event="NodeReady"
May 28 18:26:43.202390 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.202368    2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 18:26:43.244895 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.244808    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ccp2w"]
May 28 18:26:43.264427 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.264400    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vdvxl"]
May 28 18:26:43.264609 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.264573    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.266693 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.266644    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 18:26:43.266693 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.266675    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 18:26:43.267107 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.266675    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2d7l\""
May 28 18:26:43.283602 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.283577    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ccp2w"]
May 28 18:26:43.283602 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.283608    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vdvxl"]
May 28 18:26:43.283798 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.283755    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:26:43.285983 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.285818    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 18:26:43.285983 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.285855    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 18:26:43.285983 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.285908    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lsslr\""
May 28 18:26:43.286216 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.286046    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 18:26:43.365331 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.365294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzbtr\" (UniqueName: \"kubernetes.io/projected/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-kube-api-access-pzbtr\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:26:43.365488 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.365343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ljv9\" (UniqueName: \"kubernetes.io/projected/e7c82257-ba41-41c3-abf9-d912f400b80a-kube-api-access-8ljv9\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.365488 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.365375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:26:43.365488 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.365450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e7c82257-ba41-41c3-abf9-d912f400b80a-config-volume\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.365652 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.365512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.365652 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.365548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7c82257-ba41-41c3-abf9-d912f400b80a-tmp-dir\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.466805 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.466765    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzbtr\" (UniqueName: \"kubernetes.io/projected/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-kube-api-access-pzbtr\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:26:43.466984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.466824    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljv9\" (UniqueName: \"kubernetes.io/projected/e7c82257-ba41-41c3-abf9-d912f400b80a-kube-api-access-8ljv9\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.466984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.466858    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:26:43.466984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.466878    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e7c82257-ba41-41c3-abf9-d912f400b80a-config-volume\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.466984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.466906    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.466984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.466928    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7c82257-ba41-41c3-abf9-d912f400b80a-tmp-dir\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.467239 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.466987    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:43.467239 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.467046    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert podName:2f5e88e3-dd35-45b5-a7ea-4b387a9bc610 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:43.967028238 +0000 UTC m=+34.556637858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert") pod "ingress-canary-vdvxl" (UID: "2f5e88e3-dd35-45b5-a7ea-4b387a9bc610") : secret "canary-serving-cert" not found
May 28 18:26:43.467239 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.467129    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:43.467239 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.467221    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls podName:e7c82257-ba41-41c3-abf9-d912f400b80a nodeName:}" failed. No retries permitted until 2026-05-28 18:26:43.967170859 +0000 UTC m=+34.556780501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls") pod "dns-default-ccp2w" (UID: "e7c82257-ba41-41c3-abf9-d912f400b80a") : secret "dns-default-metrics-tls" not found
May 28 18:26:43.467408 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.467296    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7c82257-ba41-41c3-abf9-d912f400b80a-tmp-dir\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.467610 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.467587    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e7c82257-ba41-41c3-abf9-d912f400b80a-config-volume\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.478076 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.477886    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljv9\" (UniqueName: \"kubernetes.io/projected/e7c82257-ba41-41c3-abf9-d912f400b80a-kube-api-access-8ljv9\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.478217 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.477966    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzbtr\" (UniqueName: \"kubernetes.io/projected/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-kube-api-access-pzbtr\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:26:43.568029 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.567910    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:43.568197 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.568030    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:43.568197 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.568094    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret podName:f6f8994e-61a4-470b-874e-11d108500743 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:44.56807998 +0000 UTC m=+35.157689599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret") pod "global-pull-secret-syncer-4xtns" (UID: "f6f8994e-61a4-470b-874e-11d108500743") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:43.970449 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.970419    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:26:43.970449 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:43.970457    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:43.970964 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.970577    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:43.970964 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.970593    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:43.970964 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.970645    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls podName:e7c82257-ba41-41c3-abf9-d912f400b80a nodeName:}" failed. No retries permitted until 2026-05-28 18:26:44.970630572 +0000 UTC m=+35.560240190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls") pod "dns-default-ccp2w" (UID: "e7c82257-ba41-41c3-abf9-d912f400b80a") : secret "dns-default-metrics-tls" not found
May 28 18:26:43.970964 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:43.970658    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert podName:2f5e88e3-dd35-45b5-a7ea-4b387a9bc610 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:44.97065202 +0000 UTC m=+35.560261652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert") pod "ingress-canary-vdvxl" (UID: "2f5e88e3-dd35-45b5-a7ea-4b387a9bc610") : secret "canary-serving-cert" not found
May 28 18:26:44.573928 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:44.573831    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:44.574061 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:44.573989    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:44.574061 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:44.574058    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret podName:f6f8994e-61a4-470b-874e-11d108500743 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:46.574042832 +0000 UTC m=+37.163652455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret") pod "global-pull-secret-syncer-4xtns" (UID: "f6f8994e-61a4-470b-874e-11d108500743") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:44.976961 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:44.976924    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:26:44.976961 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:44.976962    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:44.977357 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:44.977065    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:44.977357 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:44.977132    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert podName:2f5e88e3-dd35-45b5-a7ea-4b387a9bc610 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:46.977116169 +0000 UTC m=+37.566725803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert") pod "ingress-canary-vdvxl" (UID: "2f5e88e3-dd35-45b5-a7ea-4b387a9bc610") : secret "canary-serving-cert" not found
May 28 18:26:44.977357 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:44.977213    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:44.977357 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:44.977273    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls podName:e7c82257-ba41-41c3-abf9-d912f400b80a nodeName:}" failed. No retries permitted until 2026-05-28 18:26:46.977256583 +0000 UTC m=+37.566866206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls") pod "dns-default-ccp2w" (UID: "e7c82257-ba41-41c3-abf9-d912f400b80a") : secret "dns-default-metrics-tls" not found
May 28 18:26:45.007942 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:45.007909    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:45.007942 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:45.007935    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:26:45.008060 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:45.008040    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:26:45.011529 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:45.011436    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g85kz\""
May 28 18:26:45.011529 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:45.011457    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 18:26:45.011529 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:45.011465    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 18:26:45.011529 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:45.011497    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 18:26:45.011529 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:45.011529    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 18:26:45.011808 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:45.011550    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-whbnm\""
May 28 18:26:45.200500 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:45.200459    2562 generic.go:358] "Generic (PLEG): container finished" podID="f7239413-938b-42bb-bad9-d4e42c0e0599" containerID="0bad26a0921f5d4ee783cab3155941be1539b7a38fe5ba9094a673fdab80b990" exitCode=0
May 28 18:26:45.200500 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:45.200505    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4ghf" event={"ID":"f7239413-938b-42bb-bad9-d4e42c0e0599","Type":"ContainerDied","Data":"0bad26a0921f5d4ee783cab3155941be1539b7a38fe5ba9094a673fdab80b990"}
May 28 18:26:46.204492 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:46.204465    2562 generic.go:358] "Generic (PLEG): container finished" podID="f7239413-938b-42bb-bad9-d4e42c0e0599" containerID="58e7a4ca548cf892b30eff1fbe687dd6880b009b6cb1fa0608c388854914c7ca" exitCode=0
May 28 18:26:46.204924 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:46.204511    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4ghf" event={"ID":"f7239413-938b-42bb-bad9-d4e42c0e0599","Type":"ContainerDied","Data":"58e7a4ca548cf892b30eff1fbe687dd6880b009b6cb1fa0608c388854914c7ca"}
May 28 18:26:46.588766 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:46.588644    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:46.591968 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:46.591947    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f6f8994e-61a4-470b-874e-11d108500743-original-pull-secret\") pod \"global-pull-secret-syncer-4xtns\" (UID: \"f6f8994e-61a4-470b-874e-11d108500743\") " pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:46.817738 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:46.817693    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4xtns"
May 28 18:26:46.986242 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:46.986017    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4xtns"]
May 28 18:26:46.989891 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:26:46.989861    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f8994e_61a4_470b_874e_11d108500743.slice/crio-6ea96d1fe698c80dfd87727757bd534709919ed804c09a71148b32e56f69c68e WatchSource:0}: Error finding container 6ea96d1fe698c80dfd87727757bd534709919ed804c09a71148b32e56f69c68e: Status 404 returned error can't find the container with id 6ea96d1fe698c80dfd87727757bd534709919ed804c09a71148b32e56f69c68e
May 28 18:26:46.990810 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:46.990789    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:26:46.990921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:46.990820    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:46.990984 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:46.990930    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:46.990984 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:46.990935    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:46.990984 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:46.990983    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls podName:e7c82257-ba41-41c3-abf9-d912f400b80a nodeName:}" failed. No retries permitted until 2026-05-28 18:26:50.990964724 +0000 UTC m=+41.580574360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls") pod "dns-default-ccp2w" (UID: "e7c82257-ba41-41c3-abf9-d912f400b80a") : secret "dns-default-metrics-tls" not found
May 28 18:26:46.991189 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:46.991008    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert podName:2f5e88e3-dd35-45b5-a7ea-4b387a9bc610 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:50.991001271 +0000 UTC m=+41.580610890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert") pod "ingress-canary-vdvxl" (UID: "2f5e88e3-dd35-45b5-a7ea-4b387a9bc610") : secret "canary-serving-cert" not found
May 28 18:26:47.208741 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:47.208688    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4ghf" event={"ID":"f7239413-938b-42bb-bad9-d4e42c0e0599","Type":"ContainerStarted","Data":"447ff9420191a017acef9b2428477bab9353fb03b99194805f7636b433965275"}
May 28 18:26:47.209695 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:47.209667    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4xtns" event={"ID":"f6f8994e-61a4-470b-874e-11d108500743","Type":"ContainerStarted","Data":"6ea96d1fe698c80dfd87727757bd534709919ed804c09a71148b32e56f69c68e"}
May 28 18:26:47.231418 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:47.231371    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z4ghf" podStartSLOduration=4.312657719 podStartE2EDuration="37.231357148s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="2026-05-28 18:26:11.229636221 +0000 UTC m=+1.819245839" lastFinishedPulling="2026-05-28 18:26:44.148335636 +0000 UTC m=+34.737945268" observedRunningTime="2026-05-28 18:26:47.230075874 +0000 UTC m=+37.819685515" watchObservedRunningTime="2026-05-28 18:26:47.231357148 +0000 UTC m=+37.820966790"
May 28 18:26:51.022568 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:51.022526    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:26:51.022568 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:51.022566    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:51.023071 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:51.022651    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:51.023071 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:51.022658    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:51.023071 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:51.022703    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls podName:e7c82257-ba41-41c3-abf9-d912f400b80a nodeName:}" failed. No retries permitted until 2026-05-28 18:26:59.022684607 +0000 UTC m=+49.612294255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls") pod "dns-default-ccp2w" (UID: "e7c82257-ba41-41c3-abf9-d912f400b80a") : secret "dns-default-metrics-tls" not found
May 28 18:26:51.023071 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:51.022764    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert podName:2f5e88e3-dd35-45b5-a7ea-4b387a9bc610 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:59.022750564 +0000 UTC m=+49.612360188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert") pod "ingress-canary-vdvxl" (UID: "2f5e88e3-dd35-45b5-a7ea-4b387a9bc610") : secret "canary-serving-cert" not found
May 28 18:26:52.221331 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:52.221294    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4xtns" event={"ID":"f6f8994e-61a4-470b-874e-11d108500743","Type":"ContainerStarted","Data":"c82d1f30b9bf213eb02413847f838cf37ceb06515114e637e5f8a191d035e0dc"}
May 28 18:26:52.234841 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:52.234780    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4xtns" podStartSLOduration=5.927158996 podStartE2EDuration="10.234768468s" podCreationTimestamp="2026-05-28 18:26:42 +0000 UTC" firstStartedPulling="2026-05-28 18:26:46.991652324 +0000 UTC m=+37.581261958" lastFinishedPulling="2026-05-28 18:26:51.299261799 +0000 UTC m=+41.888871430" observedRunningTime="2026-05-28 18:26:52.234524748 +0000 UTC m=+42.824134391" watchObservedRunningTime="2026-05-28 18:26:52.234768468 +0000 UTC m=+42.824378109"
May 28 18:26:59.079691 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:59.079633    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:26:59.080262 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:26:59.079705    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:26:59.080262 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:59.079894    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:59.080262 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:59.079916    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:59.080262 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:59.079986    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls podName:e7c82257-ba41-41c3-abf9-d912f400b80a nodeName:}" failed. No retries permitted until 2026-05-28 18:27:15.079959856 +0000 UTC m=+65.669569498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls") pod "dns-default-ccp2w" (UID: "e7c82257-ba41-41c3-abf9-d912f400b80a") : secret "dns-default-metrics-tls" not found
May 28 18:26:59.080262 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:26:59.080087    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert podName:2f5e88e3-dd35-45b5-a7ea-4b387a9bc610 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:15.080067974 +0000 UTC m=+65.669677595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert") pod "ingress-canary-vdvxl" (UID: "2f5e88e3-dd35-45b5-a7ea-4b387a9bc610") : secret "canary-serving-cert" not found
May 28 18:27:01.100527 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.100497    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"]
May 28 18:27:01.102646 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.102625    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:01.104003 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.103974    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-lzjbq"]
May 28 18:27:01.104755 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.104715    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 28 18:27:01.105151 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.105134    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 18:27:01.105886 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.105867    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7ccdf994fb-rbxch"]
May 28 18:27:01.105971 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.105928    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vnzjl\""
May 28 18:27:01.106034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.105988    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.106498 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.106478    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 18:27:01.106593 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.106511    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 28 18:27:01.107730 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.107703    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.108218 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.108199    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 18:27:01.108357 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.108341    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-w54mb\""
May 28 18:27:01.108412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.108368    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 28 18:27:01.108412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.108397    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 28 18:27:01.108512 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.108498    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 18:27:01.112285 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.112269    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nb29l\""
May 28 18:27:01.112376 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.112283    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 28 18:27:01.112769 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.112748    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 28 18:27:01.112868 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.112786    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 28 18:27:01.112917 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.112877    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 18:27:01.113144 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.113125    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 28 18:27:01.113257 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.113248    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 18:27:01.113864 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.113842    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 28 18:27:01.116347 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.116327    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"]
May 28 18:27:01.118052 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.118033    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-lzjbq"]
May 28 18:27:01.123671 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.123649    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7ccdf994fb-rbxch"]
May 28 18:27:01.197182 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.197145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:01.197356 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.197201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67fa7b8d-2757-4384-bf17-9f9b50060d25-serving-cert\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.197356 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.197269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj6m9\" (UniqueName: \"kubernetes.io/projected/67fa7b8d-2757-4384-bf17-9f9b50060d25-kube-api-access-qj6m9\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.197356 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.197308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67fa7b8d-2757-4384-bf17-9f9b50060d25-tmp\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.197356 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.197332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67fa7b8d-2757-4384-bf17-9f9b50060d25-snapshots\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.197356 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.197350    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x98hf\" (UniqueName: \"kubernetes.io/projected/ad16d484-f1e3-4e9b-89a0-da6c330f9599-kube-api-access-x98hf\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:01.197588 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.197369    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67fa7b8d-2757-4384-bf17-9f9b50060d25-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.197588 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.197432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67fa7b8d-2757-4384-bf17-9f9b50060d25-service-ca-bundle\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.197588 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.197469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad16d484-f1e3-4e9b-89a0-da6c330f9599-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:01.298160 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298130    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad16d484-f1e3-4e9b-89a0-da6c330f9599-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:01.298311 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298183    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:01.298311 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.298311 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298232    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67fa7b8d-2757-4384-bf17-9f9b50060d25-serving-cert\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.298311 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298256    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qj6m9\" (UniqueName: \"kubernetes.io/projected/67fa7b8d-2757-4384-bf17-9f9b50060d25-kube-api-access-qj6m9\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.298311 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-stats-auth\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.298311 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298289    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9bld\" (UniqueName: \"kubernetes.io/projected/67135a28-9521-483e-ac94-3afffb5e478f-kube-api-access-x9bld\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.298311 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:01.298295    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 18:27:01.298311 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298308    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67fa7b8d-2757-4384-bf17-9f9b50060d25-tmp\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.298713 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:01.298366    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls podName:ad16d484-f1e3-4e9b-89a0-da6c330f9599 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:01.798345847 +0000 UTC m=+52.387955494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-6bcbt" (UID: "ad16d484-f1e3-4e9b-89a0-da6c330f9599") : secret "cluster-monitoring-operator-tls" not found
May 28 18:27:01.298713 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298466    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.298713 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-default-certificate\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.298713 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298578    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67fa7b8d-2757-4384-bf17-9f9b50060d25-snapshots\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.298713 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298614    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x98hf\" (UniqueName: \"kubernetes.io/projected/ad16d484-f1e3-4e9b-89a0-da6c330f9599-kube-api-access-x98hf\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:01.298713 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298647    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67fa7b8d-2757-4384-bf17-9f9b50060d25-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.298713 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298681    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67fa7b8d-2757-4384-bf17-9f9b50060d25-service-ca-bundle\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.299090 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.298771    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67fa7b8d-2757-4384-bf17-9f9b50060d25-tmp\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.299090 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.299063    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67fa7b8d-2757-4384-bf17-9f9b50060d25-snapshots\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.299185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.299099    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad16d484-f1e3-4e9b-89a0-da6c330f9599-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:01.299219 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.299190    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67fa7b8d-2757-4384-bf17-9f9b50060d25-service-ca-bundle\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.299751 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.299710    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67fa7b8d-2757-4384-bf17-9f9b50060d25-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.301647 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.301628    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67fa7b8d-2757-4384-bf17-9f9b50060d25-serving-cert\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.306786 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.306758    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x98hf\" (UniqueName: \"kubernetes.io/projected/ad16d484-f1e3-4e9b-89a0-da6c330f9599-kube-api-access-x98hf\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:01.307055 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.307037    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj6m9\" (UniqueName: \"kubernetes.io/projected/67fa7b8d-2757-4384-bf17-9f9b50060d25-kube-api-access-qj6m9\") pod \"insights-operator-78bdfb888c-lzjbq\" (UID: \"67fa7b8d-2757-4384-bf17-9f9b50060d25\") " pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.399491 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.399406    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-stats-auth\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.399491 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.399441    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9bld\" (UniqueName: \"kubernetes.io/projected/67135a28-9521-483e-ac94-3afffb5e478f-kube-api-access-x9bld\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.399491 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.399464    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.399491 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.399482    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-default-certificate\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.399805 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.399547    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.399805 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:01.399594    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:01.899571731 +0000 UTC m=+52.489181365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : configmap references non-existent config key: service-ca.crt
May 28 18:27:01.399805 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:01.399626    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:27:01.399805 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:01.399664    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:01.899652168 +0000 UTC m=+52.489261819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : secret "router-metrics-certs-default" not found
May 28 18:27:01.401856 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.401829    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-stats-auth\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.401960 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.401879    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-default-certificate\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.411868 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.411846    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9bld\" (UniqueName: \"kubernetes.io/projected/67135a28-9521-483e-ac94-3afffb5e478f-kube-api-access-x9bld\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.422083 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.422064    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-lzjbq"
May 28 18:27:01.555817 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.555789    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-lzjbq"]
May 28 18:27:01.559086 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:01.559063    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67fa7b8d_2757_4384_bf17_9f9b50060d25.slice/crio-513bed9634d4fc545b13117244ec3bdcf2528e8d631b343172ceabae23c63f31 WatchSource:0}: Error finding container 513bed9634d4fc545b13117244ec3bdcf2528e8d631b343172ceabae23c63f31: Status 404 returned error can't find the container with id 513bed9634d4fc545b13117244ec3bdcf2528e8d631b343172ceabae23c63f31
May 28 18:27:01.802274 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.802224    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:01.802459 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:01.802387    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 18:27:01.802459 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:01.802451    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls podName:ad16d484-f1e3-4e9b-89a0-da6c330f9599 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:02.80243261 +0000 UTC m=+53.392042239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-6bcbt" (UID: "ad16d484-f1e3-4e9b-89a0-da6c330f9599") : secret "cluster-monitoring-operator-tls" not found
May 28 18:27:01.903228 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.903189    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.903429 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:01.903274    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:01.903429 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:01.903351    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:27:01.903429 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:01.903424    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:02.903406061 +0000 UTC m=+53.493015694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : configmap references non-existent config key: service-ca.crt
May 28 18:27:01.903606 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:01.903445    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:02.903435561 +0000 UTC m=+53.493045180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : secret "router-metrics-certs-default" not found
May 28 18:27:02.241290 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:02.241243    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-lzjbq" event={"ID":"67fa7b8d-2757-4384-bf17-9f9b50060d25","Type":"ContainerStarted","Data":"513bed9634d4fc545b13117244ec3bdcf2528e8d631b343172ceabae23c63f31"}
May 28 18:27:02.810415 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:02.810362    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:02.810594 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:02.810503    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 18:27:02.810594 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:02.810576    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls podName:ad16d484-f1e3-4e9b-89a0-da6c330f9599 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:04.810558448 +0000 UTC m=+55.400168084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-6bcbt" (UID: "ad16d484-f1e3-4e9b-89a0-da6c330f9599") : secret "cluster-monitoring-operator-tls" not found
May 28 18:27:02.911080 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:02.911041    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:02.911224 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:02.911180    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:02.911224 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:02.911207    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:04.911188596 +0000 UTC m=+55.500798215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : configmap references non-existent config key: service-ca.crt
May 28 18:27:02.911335 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:02.911274    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:27:02.911378 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:02.911335    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:04.911319121 +0000 UTC m=+55.500928757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : secret "router-metrics-certs-default" not found
May 28 18:27:04.246099 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:04.246060    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-lzjbq" event={"ID":"67fa7b8d-2757-4384-bf17-9f9b50060d25","Type":"ContainerStarted","Data":"f4904142ae5145032a14cb0412a9016fa3a3d5627bab4af84e98992850e44014"}
May 28 18:27:04.262618 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:04.262572    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-lzjbq" podStartSLOduration=0.939441708 podStartE2EDuration="3.262557209s" podCreationTimestamp="2026-05-28 18:27:01 +0000 UTC" firstStartedPulling="2026-05-28 18:27:01.560875351 +0000 UTC m=+52.150484971" lastFinishedPulling="2026-05-28 18:27:03.883990849 +0000 UTC m=+54.473600472" observedRunningTime="2026-05-28 18:27:04.262480437 +0000 UTC m=+54.852090080" watchObservedRunningTime="2026-05-28 18:27:04.262557209 +0000 UTC m=+54.852166850"
May 28 18:27:04.826794 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:04.826753    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:04.826969 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:04.826890    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 18:27:04.826969 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:04.826952    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls podName:ad16d484-f1e3-4e9b-89a0-da6c330f9599 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:08.826935614 +0000 UTC m=+59.416545253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-6bcbt" (UID: "ad16d484-f1e3-4e9b-89a0-da6c330f9599") : secret "cluster-monitoring-operator-tls" not found
May 28 18:27:04.927617 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:04.927583    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:04.927713 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:04.927663    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:04.927782 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:04.927770    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:27:04.927826 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:04.927801    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:08.927777078 +0000 UTC m=+59.517386700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : configmap references non-existent config key: service-ca.crt
May 28 18:27:04.927883 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:04.927831    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:08.927820907 +0000 UTC m=+59.517430532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : secret "router-metrics-certs-default" not found
May 28 18:27:06.409842 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:06.409799    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d528j_8e845702-c1e8-4dec-907a-773ed9ab8137/dns-node-resolver/0.log"
May 28 18:27:07.047662 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.047625    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"]
May 28 18:27:07.088615 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.088576    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"]
May 28 18:27:07.088805 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.088760    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:07.090958 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.090929    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 28 18:27:07.091549 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.091530    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 28 18:27:07.091659 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.091556    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5ghzs\""
May 28 18:27:07.091659 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.091616    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 28 18:27:07.209545 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.209520    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2dmsn_3ac7180b-8d0f-4c78-ad91-ec4104359bcc/node-ca/0.log"
May 28 18:27:07.244122 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.244087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:07.244290 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.244132    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r942\" (UniqueName: \"kubernetes.io/projected/c95e253e-3420-45bf-ae6d-35db3b729ff9-kube-api-access-6r942\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:07.345678 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.345597    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:07.345678 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.345633    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6r942\" (UniqueName: \"kubernetes.io/projected/c95e253e-3420-45bf-ae6d-35db3b729ff9-kube-api-access-6r942\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:07.345870 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:07.345758    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 18:27:07.345870 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:07.345832    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls podName:c95e253e-3420-45bf-ae6d-35db3b729ff9 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:07.845814727 +0000 UTC m=+58.435424347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls") pod "cluster-samples-operator-697587599-zcsbs" (UID: "c95e253e-3420-45bf-ae6d-35db3b729ff9") : secret "samples-operator-tls" not found
May 28 18:27:07.353531 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.353505    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r942\" (UniqueName: \"kubernetes.io/projected/c95e253e-3420-45bf-ae6d-35db3b729ff9-kube-api-access-6r942\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:07.849532 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:07.849493    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:07.849940 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:07.849632    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 18:27:07.849940 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:07.849698    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls podName:c95e253e-3420-45bf-ae6d-35db3b729ff9 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:08.84968076 +0000 UTC m=+59.439290379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls") pod "cluster-samples-operator-697587599-zcsbs" (UID: "c95e253e-3420-45bf-ae6d-35db3b729ff9") : secret "samples-operator-tls" not found
May 28 18:27:08.040251 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.040220    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-k44pz"]
May 28 18:27:08.053397 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.053361    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-k44pz"]
May 28 18:27:08.053538 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.053461    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-k44pz"
May 28 18:27:08.055916 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.055890    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wgkqm\""
May 28 18:27:08.056044 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.055931    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 28 18:27:08.056044 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.055932    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 28 18:27:08.152974 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.152890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89hv4\" (UniqueName: \"kubernetes.io/projected/f033b0a7-f835-4a7c-a0ef-ba47ea93942d-kube-api-access-89hv4\") pod \"volume-data-source-validator-5cf8c89d64-k44pz\" (UID: \"f033b0a7-f835-4a7c-a0ef-ba47ea93942d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-k44pz"
May 28 18:27:08.253433 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.253397    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89hv4\" (UniqueName: \"kubernetes.io/projected/f033b0a7-f835-4a7c-a0ef-ba47ea93942d-kube-api-access-89hv4\") pod \"volume-data-source-validator-5cf8c89d64-k44pz\" (UID: \"f033b0a7-f835-4a7c-a0ef-ba47ea93942d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-k44pz"
May 28 18:27:08.261971 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.261944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89hv4\" (UniqueName: \"kubernetes.io/projected/f033b0a7-f835-4a7c-a0ef-ba47ea93942d-kube-api-access-89hv4\") pod \"volume-data-source-validator-5cf8c89d64-k44pz\" (UID: \"f033b0a7-f835-4a7c-a0ef-ba47ea93942d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-k44pz"
May 28 18:27:08.362482 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.362450    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-k44pz"
May 28 18:27:08.475570 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.475538    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-k44pz"]
May 28 18:27:08.478350 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:08.478321    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf033b0a7_f835_4a7c_a0ef_ba47ea93942d.slice/crio-8972388cbb8e6ab71fa0bef4ffa2de08335a20619b39b3075bd7fad9fd2c2591 WatchSource:0}: Error finding container 8972388cbb8e6ab71fa0bef4ffa2de08335a20619b39b3075bd7fad9fd2c2591: Status 404 returned error can't find the container with id 8972388cbb8e6ab71fa0bef4ffa2de08335a20619b39b3075bd7fad9fd2c2591
May 28 18:27:08.857793 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.857738    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:08.858189 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.857829    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:08.858189 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:08.857877    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 18:27:08.858189 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:08.857954    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls podName:ad16d484-f1e3-4e9b-89a0-da6c330f9599 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:16.857936317 +0000 UTC m=+67.447545936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-6bcbt" (UID: "ad16d484-f1e3-4e9b-89a0-da6c330f9599") : secret "cluster-monitoring-operator-tls" not found
May 28 18:27:08.858189 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:08.857984    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 18:27:08.858189 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:08.858042    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls podName:c95e253e-3420-45bf-ae6d-35db3b729ff9 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:10.858027808 +0000 UTC m=+61.447637427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls") pod "cluster-samples-operator-697587599-zcsbs" (UID: "c95e253e-3420-45bf-ae6d-35db3b729ff9") : secret "samples-operator-tls" not found
May 28 18:27:08.958393 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.958354    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:08.958564 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:08.958494    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:27:08.958564 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:08.958521    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:08.958564 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:08.958555    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:16.958538559 +0000 UTC m=+67.548148178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : secret "router-metrics-certs-default" not found
May 28 18:27:08.958743 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:08.958672    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:16.958654951 +0000 UTC m=+67.548264581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : configmap references non-existent config key: service-ca.crt
May 28 18:27:09.047905 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.047873    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fbgk7"]
May 28 18:27:09.050034 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.050010    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.052360 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.052332    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 28 18:27:09.052472 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.052339    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 28 18:27:09.053378 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.053247    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hk6kt\""
May 28 18:27:09.053378 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.053257    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 28 18:27:09.053378 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.053280    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 28 18:27:09.058116 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.058093    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 28 18:27:09.058975 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.058956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrtgc\" (UniqueName: \"kubernetes.io/projected/94c9365b-36fc-49e8-b3d2-71b861c649ec-kube-api-access-jrtgc\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.059067 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.058997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94c9365b-36fc-49e8-b3d2-71b861c649ec-config\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.059067 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.059049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94c9365b-36fc-49e8-b3d2-71b861c649ec-serving-cert\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.059172 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.059098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94c9365b-36fc-49e8-b3d2-71b861c649ec-trusted-ca\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.061069 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.061045    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fbgk7"]
May 28 18:27:09.160020 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.159936    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94c9365b-36fc-49e8-b3d2-71b861c649ec-trusted-ca\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.160178 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.160038    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrtgc\" (UniqueName: \"kubernetes.io/projected/94c9365b-36fc-49e8-b3d2-71b861c649ec-kube-api-access-jrtgc\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.160178 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.160082    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94c9365b-36fc-49e8-b3d2-71b861c649ec-config\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.160178 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.160121    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94c9365b-36fc-49e8-b3d2-71b861c649ec-serving-cert\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.160873 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.160815    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94c9365b-36fc-49e8-b3d2-71b861c649ec-config\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.161017 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.160995    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94c9365b-36fc-49e8-b3d2-71b861c649ec-trusted-ca\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.162705 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.162682    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94c9365b-36fc-49e8-b3d2-71b861c649ec-serving-cert\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.170609 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.170585    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrtgc\" (UniqueName: \"kubernetes.io/projected/94c9365b-36fc-49e8-b3d2-71b861c649ec-kube-api-access-jrtgc\") pod \"console-operator-76dff48d59-fbgk7\" (UID: \"94c9365b-36fc-49e8-b3d2-71b861c649ec\") " pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.196887 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.196863    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x67nm"
May 28 18:27:09.257257 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.257221    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-k44pz" event={"ID":"f033b0a7-f835-4a7c-a0ef-ba47ea93942d","Type":"ContainerStarted","Data":"8972388cbb8e6ab71fa0bef4ffa2de08335a20619b39b3075bd7fad9fd2c2591"}
May 28 18:27:09.361588 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.361552    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:09.495491 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:09.495458    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-fbgk7"]
May 28 18:27:09.498577 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:09.498550    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c9365b_36fc_49e8_b3d2_71b861c649ec.slice/crio-f0e92e712a687f8745b4c3bf502767e5446eeb14ad0ce935e11a64c3afdebe47 WatchSource:0}: Error finding container f0e92e712a687f8745b4c3bf502767e5446eeb14ad0ce935e11a64c3afdebe47: Status 404 returned error can't find the container with id f0e92e712a687f8745b4c3bf502767e5446eeb14ad0ce935e11a64c3afdebe47
May 28 18:27:10.260236 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.260194    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-k44pz" event={"ID":"f033b0a7-f835-4a7c-a0ef-ba47ea93942d","Type":"ContainerStarted","Data":"82282566ce53808bbf465f64603daf19f03e9948d90a23448439391f44b29824"}
May 28 18:27:10.261273 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.261238    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7" event={"ID":"94c9365b-36fc-49e8-b3d2-71b861c649ec","Type":"ContainerStarted","Data":"f0e92e712a687f8745b4c3bf502767e5446eeb14ad0ce935e11a64c3afdebe47"}
May 28 18:27:10.273598 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.273554    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-k44pz" podStartSLOduration=0.723039514 podStartE2EDuration="2.273541162s" podCreationTimestamp="2026-05-28 18:27:08 +0000 UTC" firstStartedPulling="2026-05-28 18:27:08.480129657 +0000 UTC m=+59.069739276" lastFinishedPulling="2026-05-28 18:27:10.030631302 +0000 UTC m=+60.620240924" observedRunningTime="2026-05-28 18:27:10.273104441 +0000 UTC m=+60.862714083" watchObservedRunningTime="2026-05-28 18:27:10.273541162 +0000 UTC m=+60.863150802"
May 28 18:27:10.345184 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.345101    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bd99bc869-rrcr2"]
May 28 18:27:10.347288 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.347259    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.349488 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.349463    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 18:27:10.349488 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.349485    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 18:27:10.349688 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.349562    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 18:27:10.350093 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.350075    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-brjsz\""
May 28 18:27:10.355476 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.355457    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 18:27:10.358569 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.358531    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bd99bc869-rrcr2"]
May 28 18:27:10.369832 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.369797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-registry-certificates\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.369954 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.369842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjstn\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-kube-api-access-qjstn\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.370002 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.369979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-trusted-ca\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.370044 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.370022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa808ccb-b32f-4354-be47-a083d2122da2-ca-trust-extracted\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.370082 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.370062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.370131 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.370099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-installation-pull-secrets\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.370179 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.370143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-image-registry-private-configuration\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.370226 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.370195    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-bound-sa-token\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.470994 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.470948    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-image-registry-private-configuration\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.470994 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.470991    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-bound-sa-token\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.471202 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.471031    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-registry-certificates\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.471202 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.471048    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjstn\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-kube-api-access-qjstn\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.471272 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.471248    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-trusted-ca\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.471311 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.471289    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa808ccb-b32f-4354-be47-a083d2122da2-ca-trust-extracted\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.471354 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.471323    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.471429 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:10.471408    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:27:10.471429 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:10.471428    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd99bc869-rrcr2: secret "image-registry-tls" not found
May 28 18:27:10.471523 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:10.471493    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls podName:fa808ccb-b32f-4354-be47-a083d2122da2 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:10.97147217 +0000 UTC m=+61.561081805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls") pod "image-registry-bd99bc869-rrcr2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2") : secret "image-registry-tls" not found
May 28 18:27:10.471523 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.471516    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-installation-pull-secrets\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.471657 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.471631    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa808ccb-b32f-4354-be47-a083d2122da2-ca-trust-extracted\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.471749 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.471708    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-registry-certificates\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.472296 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.472277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-trusted-ca\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.473662 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.473641    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-installation-pull-secrets\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.473782 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.473685    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-image-registry-private-configuration\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.481362 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.481334    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-bound-sa-token\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.482184 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.482166    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjstn\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-kube-api-access-qjstn\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.875609 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.875568    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:10.875809 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:10.875717    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 18:27:10.875858 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:10.875825    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls podName:c95e253e-3420-45bf-ae6d-35db3b729ff9 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:14.875803132 +0000 UTC m=+65.465412768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls") pod "cluster-samples-operator-697587599-zcsbs" (UID: "c95e253e-3420-45bf-ae6d-35db3b729ff9") : secret "samples-operator-tls" not found
May 28 18:27:10.976498 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:10.976406    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:10.976685 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:10.976536    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:27:10.976685 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:10.976562    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd99bc869-rrcr2: secret "image-registry-tls" not found
May 28 18:27:10.976685 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:10.976620    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls podName:fa808ccb-b32f-4354-be47-a083d2122da2 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:11.976605022 +0000 UTC m=+62.566214641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls") pod "image-registry-bd99bc869-rrcr2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2") : secret "image-registry-tls" not found
May 28 18:27:11.047105 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.047072    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"]
May 28 18:27:11.049611 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.049594    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"
May 28 18:27:11.051854 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.051829    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 28 18:27:11.051854 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.051845    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 28 18:27:11.052030 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.051845    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kc54h\""
May 28 18:27:11.052030 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.051896    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 28 18:27:11.052030 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.051845    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 28 18:27:11.057369 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.057350    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"]
May 28 18:27:11.077931 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.077903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-ldxnw\" (UID: \"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"
May 28 18:27:11.078054 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.077970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4kfc\" (UniqueName: \"kubernetes.io/projected/e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae-kube-api-access-m4kfc\") pod \"kube-storage-version-migrator-operator-565644f49-ldxnw\" (UID: \"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"
May 28 18:27:11.078136 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.078073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae-config\") pod \"kube-storage-version-migrator-operator-565644f49-ldxnw\" (UID: \"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"
May 28 18:27:11.150650 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.150619    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"]
May 28 18:27:11.152611 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.152596    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"
May 28 18:27:11.154656 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.154639    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 28 18:27:11.154907 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.154891    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 28 18:27:11.154960 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.154907    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 28 18:27:11.154996 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.154981    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pwmnj\""
May 28 18:27:11.155116 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.155099    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 28 18:27:11.163216 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.163193    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"]
May 28 18:27:11.178829 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.178805    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-ldxnw\" (UID: \"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"
May 28 18:27:11.178914 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.178854    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4kfc\" (UniqueName: \"kubernetes.io/projected/e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae-kube-api-access-m4kfc\") pod \"kube-storage-version-migrator-operator-565644f49-ldxnw\" (UID: \"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"
May 28 18:27:11.178914 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.178886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3454ad1-f3d5-47c0-a890-522f6aa4d173-serving-cert\") pod \"service-ca-operator-57b5b68b8-656pb\" (UID: \"c3454ad1-f3d5-47c0-a890-522f6aa4d173\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"
May 28 18:27:11.179000 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.178916    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3454ad1-f3d5-47c0-a890-522f6aa4d173-config\") pod \"service-ca-operator-57b5b68b8-656pb\" (UID: \"c3454ad1-f3d5-47c0-a890-522f6aa4d173\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"
May 28 18:27:11.179000 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.178953    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae-config\") pod \"kube-storage-version-migrator-operator-565644f49-ldxnw\" (UID: \"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"
May 28 18:27:11.179120 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.179103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn5zp\" (UniqueName: \"kubernetes.io/projected/c3454ad1-f3d5-47c0-a890-522f6aa4d173-kube-api-access-qn5zp\") pod \"service-ca-operator-57b5b68b8-656pb\" (UID: \"c3454ad1-f3d5-47c0-a890-522f6aa4d173\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"
May 28 18:27:11.179456 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.179440    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae-config\") pod \"kube-storage-version-migrator-operator-565644f49-ldxnw\" (UID: \"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"
May 28 18:27:11.180983 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.180965    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-ldxnw\" (UID: \"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"
May 28 18:27:11.192330 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.192306    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4kfc\" (UniqueName: \"kubernetes.io/projected/e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae-kube-api-access-m4kfc\") pod \"kube-storage-version-migrator-operator-565644f49-ldxnw\" (UID: \"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"
May 28 18:27:11.279647 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.279550    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3454ad1-f3d5-47c0-a890-522f6aa4d173-serving-cert\") pod \"service-ca-operator-57b5b68b8-656pb\" (UID: \"c3454ad1-f3d5-47c0-a890-522f6aa4d173\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"
May 28 18:27:11.279647 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.279586    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3454ad1-f3d5-47c0-a890-522f6aa4d173-config\") pod \"service-ca-operator-57b5b68b8-656pb\" (UID: \"c3454ad1-f3d5-47c0-a890-522f6aa4d173\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"
May 28 18:27:11.280152 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.279742    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qn5zp\" (UniqueName: \"kubernetes.io/projected/c3454ad1-f3d5-47c0-a890-522f6aa4d173-kube-api-access-qn5zp\") pod \"service-ca-operator-57b5b68b8-656pb\" (UID: \"c3454ad1-f3d5-47c0-a890-522f6aa4d173\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"
May 28 18:27:11.280306 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.280282    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3454ad1-f3d5-47c0-a890-522f6aa4d173-config\") pod \"service-ca-operator-57b5b68b8-656pb\" (UID: \"c3454ad1-f3d5-47c0-a890-522f6aa4d173\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"
May 28 18:27:11.281888 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.281872    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3454ad1-f3d5-47c0-a890-522f6aa4d173-serving-cert\") pod \"service-ca-operator-57b5b68b8-656pb\" (UID: \"c3454ad1-f3d5-47c0-a890-522f6aa4d173\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"
May 28 18:27:11.289122 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.289099    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn5zp\" (UniqueName: \"kubernetes.io/projected/c3454ad1-f3d5-47c0-a890-522f6aa4d173-kube-api-access-qn5zp\") pod \"service-ca-operator-57b5b68b8-656pb\" (UID: \"c3454ad1-f3d5-47c0-a890-522f6aa4d173\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"
May 28 18:27:11.359176 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.359135    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"
May 28 18:27:11.461668 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.461629    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"
May 28 18:27:11.881422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.881388    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw"]
May 28 18:27:11.884264 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:11.884225    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f23dbf_c706_4dca_a5fd_89e5f9cf2fae.slice/crio-fdb83cc93283f68c3f7e3937dcdfc48bfa6deed849bd8ca1ce084f79221af049 WatchSource:0}: Error finding container fdb83cc93283f68c3f7e3937dcdfc48bfa6deed849bd8ca1ce084f79221af049: Status 404 returned error can't find the container with id fdb83cc93283f68c3f7e3937dcdfc48bfa6deed849bd8ca1ce084f79221af049
May 28 18:27:11.898848 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.898819    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb"]
May 28 18:27:11.901880 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:11.901852    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3454ad1_f3d5_47c0_a890_522f6aa4d173.slice/crio-1e56e19b0043884153c5d78adb845e329988c3b099b7b204bc91171b5a3cc715 WatchSource:0}: Error finding container 1e56e19b0043884153c5d78adb845e329988c3b099b7b204bc91171b5a3cc715: Status 404 returned error can't find the container with id 1e56e19b0043884153c5d78adb845e329988c3b099b7b204bc91171b5a3cc715
May 28 18:27:11.985921 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:11.985883    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:11.986131 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:11.986051    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:27:11.986131 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:11.986076    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd99bc869-rrcr2: secret "image-registry-tls" not found
May 28 18:27:11.986245 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:11.986144    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls podName:fa808ccb-b32f-4354-be47-a083d2122da2 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:13.986124042 +0000 UTC m=+64.575733677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls") pod "image-registry-bd99bc869-rrcr2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2") : secret "image-registry-tls" not found
May 28 18:27:12.265598 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:12.265562    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb" event={"ID":"c3454ad1-f3d5-47c0-a890-522f6aa4d173","Type":"ContainerStarted","Data":"1e56e19b0043884153c5d78adb845e329988c3b099b7b204bc91171b5a3cc715"}
May 28 18:27:12.266479 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:12.266456    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw" event={"ID":"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae","Type":"ContainerStarted","Data":"fdb83cc93283f68c3f7e3937dcdfc48bfa6deed849bd8ca1ce084f79221af049"}
May 28 18:27:12.267853 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:12.267835    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/0.log"
May 28 18:27:12.267945 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:12.267868    2562 generic.go:358] "Generic (PLEG): container finished" podID="94c9365b-36fc-49e8-b3d2-71b861c649ec" containerID="9590f0024b76a242fa0e76479b6cfbf09d4a7ff037db0852346925c0a4c2de7c" exitCode=255
May 28 18:27:12.267945 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:12.267890    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7" event={"ID":"94c9365b-36fc-49e8-b3d2-71b861c649ec","Type":"ContainerDied","Data":"9590f0024b76a242fa0e76479b6cfbf09d4a7ff037db0852346925c0a4c2de7c"}
May 28 18:27:12.268207 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:12.268191    2562 scope.go:117] "RemoveContainer" containerID="9590f0024b76a242fa0e76479b6cfbf09d4a7ff037db0852346925c0a4c2de7c"
May 28 18:27:13.271931 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:13.271898    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/1.log"
May 28 18:27:13.272381 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:13.272245    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/0.log"
May 28 18:27:13.272381 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:13.272285    2562 generic.go:358] "Generic (PLEG): container finished" podID="94c9365b-36fc-49e8-b3d2-71b861c649ec" containerID="bf56395fc8c891037b785deec868d160d7ff83fd65ecca95d72c0871259782b3" exitCode=255
May 28 18:27:13.272381 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:13.272321    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7" event={"ID":"94c9365b-36fc-49e8-b3d2-71b861c649ec","Type":"ContainerDied","Data":"bf56395fc8c891037b785deec868d160d7ff83fd65ecca95d72c0871259782b3"}
May 28 18:27:13.272381 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:13.272357    2562 scope.go:117] "RemoveContainer" containerID="9590f0024b76a242fa0e76479b6cfbf09d4a7ff037db0852346925c0a4c2de7c"
May 28 18:27:13.272669 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:13.272649    2562 scope.go:117] "RemoveContainer" containerID="bf56395fc8c891037b785deec868d160d7ff83fd65ecca95d72c0871259782b3"
May 28 18:27:13.272942 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:13.272910    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fbgk7_openshift-console-operator(94c9365b-36fc-49e8-b3d2-71b861c649ec)\"" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7" podUID="94c9365b-36fc-49e8-b3d2-71b861c649ec"
May 28 18:27:14.004634 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:14.004597    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:14.004830 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:14.004761    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:27:14.004830 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:14.004788    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd99bc869-rrcr2: secret "image-registry-tls" not found
May 28 18:27:14.004927 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:14.004860    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls podName:fa808ccb-b32f-4354-be47-a083d2122da2 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:18.004838831 +0000 UTC m=+68.594448451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls") pod "image-registry-bd99bc869-rrcr2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2") : secret "image-registry-tls" not found
May 28 18:27:14.276660 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:14.276583    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/1.log"
May 28 18:27:14.277107 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:14.277036    2562 scope.go:117] "RemoveContainer" containerID="bf56395fc8c891037b785deec868d160d7ff83fd65ecca95d72c0871259782b3"
May 28 18:27:14.277269 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:14.277247    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fbgk7_openshift-console-operator(94c9365b-36fc-49e8-b3d2-71b861c649ec)\"" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7" podUID="94c9365b-36fc-49e8-b3d2-71b861c649ec"
May 28 18:27:14.711978 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:14.711944    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:27:14.714179 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:14.714160    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 18:27:14.722923 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:14.722901    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 18:27:14.722997 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:14.722987    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs podName:26b71d0c-8000-421e-b031-4805782b9c85 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:18.722968925 +0000 UTC m=+129.312578547 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs") pod "network-metrics-daemon-2jrmq" (UID: "26b71d0c-8000-421e-b031-4805782b9c85") : secret "metrics-daemon-secret" not found
May 28 18:27:14.812654 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:14.812616    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pz9l\" (UniqueName: \"kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l\") pod \"network-check-target-dswfb\" (UID: \"b56fcf23-ddc9-450c-bcf5-a58d5609cc25\") " pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:27:14.814662 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:14.814639    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 18:27:14.825016 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:14.824986    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 18:27:14.835970 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:14.835936    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pz9l\" (UniqueName: \"kubernetes.io/projected/b56fcf23-ddc9-450c-bcf5-a58d5609cc25-kube-api-access-6pz9l\") pod \"network-check-target-dswfb\" (UID: \"b56fcf23-ddc9-450c-bcf5-a58d5609cc25\") " pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:27:14.913350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:14.913306    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:14.913513 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:14.913419    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 18:27:14.913513 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:14.913473    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls podName:c95e253e-3420-45bf-ae6d-35db3b729ff9 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:22.913458929 +0000 UTC m=+73.503068548 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls") pod "cluster-samples-operator-697587599-zcsbs" (UID: "c95e253e-3420-45bf-ae6d-35db3b729ff9") : secret "samples-operator-tls" not found
May 28 18:27:15.029351 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.029330    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g85kz\""
May 28 18:27:15.037567 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.037545    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:27:15.115092 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.114843    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:27:15.115092 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.114897    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:27:15.115092 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:15.114998    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:27:15.115092 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:15.115072    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert podName:2f5e88e3-dd35-45b5-a7ea-4b387a9bc610 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:47.115051194 +0000 UTC m=+97.704660817 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert") pod "ingress-canary-vdvxl" (UID: "2f5e88e3-dd35-45b5-a7ea-4b387a9bc610") : secret "canary-serving-cert" not found
May 28 18:27:15.115092 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:15.115072    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:27:15.115425 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:15.115107    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls podName:e7c82257-ba41-41c3-abf9-d912f400b80a nodeName:}" failed. No retries permitted until 2026-05-28 18:27:47.115098672 +0000 UTC m=+97.704708291 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls") pod "dns-default-ccp2w" (UID: "e7c82257-ba41-41c3-abf9-d912f400b80a") : secret "dns-default-metrics-tls" not found
May 28 18:27:15.167748 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.167703    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dswfb"]
May 28 18:27:15.170684 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:15.170645    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56fcf23_ddc9_450c_bcf5_a58d5609cc25.slice/crio-db782b2342e6a3e369cea7e39b399e583062a2fd9f23b95192216a52907371ab WatchSource:0}: Error finding container db782b2342e6a3e369cea7e39b399e583062a2fd9f23b95192216a52907371ab: Status 404 returned error can't find the container with id db782b2342e6a3e369cea7e39b399e583062a2fd9f23b95192216a52907371ab
May 28 18:27:15.281242 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.281146    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dswfb" event={"ID":"b56fcf23-ddc9-450c-bcf5-a58d5609cc25","Type":"ContainerStarted","Data":"db782b2342e6a3e369cea7e39b399e583062a2fd9f23b95192216a52907371ab"}
May 28 18:27:15.282478 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.282441    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb" event={"ID":"c3454ad1-f3d5-47c0-a890-522f6aa4d173","Type":"ContainerStarted","Data":"03f131f83fe1ec7b83b33e5af2354be80f0379decc2f3f6baed0a7eff52e7f00"}
May 28 18:27:15.283848 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.283830    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw" event={"ID":"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae","Type":"ContainerStarted","Data":"969481bd54fd4dd4dfe7efe1d05205dd9d1ab0070e256c70ed0b2f8669de2f67"}
May 28 18:27:15.290208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.290188    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-d7qp2"]
May 28 18:27:15.299623 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.299576    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb" podStartSLOduration=1.245949663 podStartE2EDuration="4.2995625s" podCreationTimestamp="2026-05-28 18:27:11 +0000 UTC" firstStartedPulling="2026-05-28 18:27:11.903664774 +0000 UTC m=+62.493274393" lastFinishedPulling="2026-05-28 18:27:14.957277599 +0000 UTC m=+65.546887230" observedRunningTime="2026-05-28 18:27:15.298532371 +0000 UTC m=+65.888142016" watchObservedRunningTime="2026-05-28 18:27:15.2995625 +0000 UTC m=+65.889172144"
May 28 18:27:15.315011 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.314961    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw" podStartSLOduration=1.238881446 podStartE2EDuration="4.314942384s" podCreationTimestamp="2026-05-28 18:27:11 +0000 UTC" firstStartedPulling="2026-05-28 18:27:11.886132982 +0000 UTC m=+62.475742601" lastFinishedPulling="2026-05-28 18:27:14.962193906 +0000 UTC m=+65.551803539" observedRunningTime="2026-05-28 18:27:15.313451623 +0000 UTC m=+65.903061266" watchObservedRunningTime="2026-05-28 18:27:15.314942384 +0000 UTC m=+65.904552026"
May 28 18:27:15.321818 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.321767    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-d7qp2"]
May 28 18:27:15.321952 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.321913    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d7qp2"
May 28 18:27:15.324280 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.324095    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-smfv6\""
May 28 18:27:15.418488 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.418442    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snr8w\" (UniqueName: \"kubernetes.io/projected/1fb71e73-6cbc-42bd-9abc-0ee8d0aa4d54-kube-api-access-snr8w\") pod \"network-check-source-7f44b6dd87-d7qp2\" (UID: \"1fb71e73-6cbc-42bd-9abc-0ee8d0aa4d54\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d7qp2"
May 28 18:27:15.519682 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.519641    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snr8w\" (UniqueName: \"kubernetes.io/projected/1fb71e73-6cbc-42bd-9abc-0ee8d0aa4d54-kube-api-access-snr8w\") pod \"network-check-source-7f44b6dd87-d7qp2\" (UID: \"1fb71e73-6cbc-42bd-9abc-0ee8d0aa4d54\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d7qp2"
May 28 18:27:15.527063 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.527029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snr8w\" (UniqueName: \"kubernetes.io/projected/1fb71e73-6cbc-42bd-9abc-0ee8d0aa4d54-kube-api-access-snr8w\") pod \"network-check-source-7f44b6dd87-d7qp2\" (UID: \"1fb71e73-6cbc-42bd-9abc-0ee8d0aa4d54\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d7qp2"
May 28 18:27:15.632422 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.632332    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d7qp2"
May 28 18:27:15.778404 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:15.778362    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-d7qp2"]
May 28 18:27:15.780563 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:15.780532    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb71e73_6cbc_42bd_9abc_0ee8d0aa4d54.slice/crio-495ecdd4c8ec71447fe82776b3edb8c67e63793ba71651afa8cfa34fdb630254 WatchSource:0}: Error finding container 495ecdd4c8ec71447fe82776b3edb8c67e63793ba71651afa8cfa34fdb630254: Status 404 returned error can't find the container with id 495ecdd4c8ec71447fe82776b3edb8c67e63793ba71651afa8cfa34fdb630254
May 28 18:27:16.290065 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:16.289993    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d7qp2" event={"ID":"1fb71e73-6cbc-42bd-9abc-0ee8d0aa4d54","Type":"ContainerStarted","Data":"495ecdd4c8ec71447fe82776b3edb8c67e63793ba71651afa8cfa34fdb630254"}
May 28 18:27:16.932163 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:16.932080    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:16.932353 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:16.932229    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 18:27:16.932353 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:16.932314    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls podName:ad16d484-f1e3-4e9b-89a0-da6c330f9599 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:32.932291629 +0000 UTC m=+83.521901252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-6bcbt" (UID: "ad16d484-f1e3-4e9b-89a0-da6c330f9599") : secret "cluster-monitoring-operator-tls" not found
May 28 18:27:17.033130 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:17.033085    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:17.033313 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:17.033253    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:17.033313 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:17.033260    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 18:27:17.033435 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:17.033336    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:33.033319756 +0000 UTC m=+83.622929390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : secret "router-metrics-certs-default" not found
May 28 18:27:17.033435 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:17.033401    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle podName:67135a28-9521-483e-ac94-3afffb5e478f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:33.033379123 +0000 UTC m=+83.622988765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle") pod "router-default-7ccdf994fb-rbxch" (UID: "67135a28-9521-483e-ac94-3afffb5e478f") : configmap references non-existent config key: service-ca.crt
May 28 18:27:18.042870 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.042830    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:18.043328 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:18.043010    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:27:18.043328 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:18.043036    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd99bc869-rrcr2: secret "image-registry-tls" not found
May 28 18:27:18.043328 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:18.043110    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls podName:fa808ccb-b32f-4354-be47-a083d2122da2 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:26.043088942 +0000 UTC m=+76.632698564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls") pod "image-registry-bd99bc869-rrcr2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2") : secret "image-registry-tls" not found
May 28 18:27:18.297940 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.297843    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d7qp2" event={"ID":"1fb71e73-6cbc-42bd-9abc-0ee8d0aa4d54","Type":"ContainerStarted","Data":"2bd65ce117801618dc03e440b058a6328cf84d79426969296e715f9c79cca9fd"}
May 28 18:27:18.300166 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.300133    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dswfb" event={"ID":"b56fcf23-ddc9-450c-bcf5-a58d5609cc25","Type":"ContainerStarted","Data":"baac196c4af0a1a753c5f7c6fbbe23fa4447970873ec8b20dbe3bf6227e606bb"}
May 28 18:27:18.300305 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.300270    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:27:18.319579 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.319526    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d7qp2" podStartSLOduration=0.900145949 podStartE2EDuration="3.31950973s" podCreationTimestamp="2026-05-28 18:27:15 +0000 UTC" firstStartedPulling="2026-05-28 18:27:15.783992569 +0000 UTC m=+66.373602188" lastFinishedPulling="2026-05-28 18:27:18.20335635 +0000 UTC m=+68.792965969" observedRunningTime="2026-05-28 18:27:18.318148397 +0000 UTC m=+68.907758039" watchObservedRunningTime="2026-05-28 18:27:18.31950973 +0000 UTC m=+68.909119370"
May 28 18:27:18.413014 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.412947    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dswfb" podStartSLOduration=65.369862731 podStartE2EDuration="1m8.412928047s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="2026-05-28 18:27:15.172588215 +0000 UTC m=+65.762197848" lastFinishedPulling="2026-05-28 18:27:18.215653518 +0000 UTC m=+68.805263164" observedRunningTime="2026-05-28 18:27:18.335846812 +0000 UTC m=+68.925456463" watchObservedRunningTime="2026-05-28 18:27:18.412928047 +0000 UTC m=+69.002537689"
May 28 18:27:18.413307 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.413286    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-npm74"]
May 28 18:27:18.415579 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.415565    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.417846 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.417827    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 18:27:18.418119 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.418104    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 18:27:18.418590 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.418575    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qfd2r\""
May 28 18:27:18.430050 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.430025    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-npm74"]
May 28 18:27:18.447351 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.447324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e4f5d47-c878-4f30-9531-19fc51e114ee-data-volume\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.447450 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.447370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.447517 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.447499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e4f5d47-c878-4f30-9531-19fc51e114ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.447550 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.447531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e4f5d47-c878-4f30-9531-19fc51e114ee-crio-socket\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.447595 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.447582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqqc2\" (UniqueName: \"kubernetes.io/projected/2e4f5d47-c878-4f30-9531-19fc51e114ee-kube-api-access-mqqc2\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.548307 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.548216    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e4f5d47-c878-4f30-9531-19fc51e114ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.548307 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.548256    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e4f5d47-c878-4f30-9531-19fc51e114ee-crio-socket\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.548307 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.548290    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqqc2\" (UniqueName: \"kubernetes.io/projected/2e4f5d47-c878-4f30-9531-19fc51e114ee-kube-api-access-mqqc2\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.548562 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.548312    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e4f5d47-c878-4f30-9531-19fc51e114ee-data-volume\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.548562 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.548339    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.548562 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.548363    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e4f5d47-c878-4f30-9531-19fc51e114ee-crio-socket\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.548562 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:18.548441    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:27:18.548562 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:18.548505    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls podName:2e4f5d47-c878-4f30-9531-19fc51e114ee nodeName:}" failed. No retries permitted until 2026-05-28 18:27:19.048484447 +0000 UTC m=+69.638094082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npm74" (UID: "2e4f5d47-c878-4f30-9531-19fc51e114ee") : secret "insights-runtime-extractor-tls" not found
May 28 18:27:18.548814 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.548684    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e4f5d47-c878-4f30-9531-19fc51e114ee-data-volume\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.548894 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.548874    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e4f5d47-c878-4f30-9531-19fc51e114ee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:18.560976 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:18.560951    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqqc2\" (UniqueName: \"kubernetes.io/projected/2e4f5d47-c878-4f30-9531-19fc51e114ee-kube-api-access-mqqc2\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:19.053072 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:19.053022    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:19.053647 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:19.053207    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:27:19.053647 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:19.053281    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls podName:2e4f5d47-c878-4f30-9531-19fc51e114ee nodeName:}" failed. No retries permitted until 2026-05-28 18:27:20.053265066 +0000 UTC m=+70.642874684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npm74" (UID: "2e4f5d47-c878-4f30-9531-19fc51e114ee") : secret "insights-runtime-extractor-tls" not found
May 28 18:27:19.361885 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:19.361790    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:19.361885 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:19.361827    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:19.362245 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:19.362229    2562 scope.go:117] "RemoveContainer" containerID="bf56395fc8c891037b785deec868d160d7ff83fd65ecca95d72c0871259782b3"
May 28 18:27:19.362436 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:19.362415    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-fbgk7_openshift-console-operator(94c9365b-36fc-49e8-b3d2-71b861c649ec)\"" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7" podUID="94c9365b-36fc-49e8-b3d2-71b861c649ec"
May 28 18:27:20.063412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:20.063370    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:20.063840 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:20.063504    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:27:20.063840 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:20.063558    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls podName:2e4f5d47-c878-4f30-9531-19fc51e114ee nodeName:}" failed. No retries permitted until 2026-05-28 18:27:22.063544647 +0000 UTC m=+72.653154266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npm74" (UID: "2e4f5d47-c878-4f30-9531-19fc51e114ee") : secret "insights-runtime-extractor-tls" not found
May 28 18:27:22.080533 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:22.080486    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:22.080957 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:22.080645    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:27:22.080957 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:22.080716    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls podName:2e4f5d47-c878-4f30-9531-19fc51e114ee nodeName:}" failed. No retries permitted until 2026-05-28 18:27:26.080689312 +0000 UTC m=+76.670298946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npm74" (UID: "2e4f5d47-c878-4f30-9531-19fc51e114ee") : secret "insights-runtime-extractor-tls" not found
May 28 18:27:22.987830 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:22.987791    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:22.988008 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:22.987939    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 18:27:22.988008 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:22.988005    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls podName:c95e253e-3420-45bf-ae6d-35db3b729ff9 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:38.987987465 +0000 UTC m=+89.577597084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls") pod "cluster-samples-operator-697587599-zcsbs" (UID: "c95e253e-3420-45bf-ae6d-35db3b729ff9") : secret "samples-operator-tls" not found
May 28 18:27:26.117431 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:26.117394    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:26.117823 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:26.117486    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:26.117823 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:26.117527    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:27:26.117823 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:26.117539    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:27:26.117823 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:26.117554    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bd99bc869-rrcr2: secret "image-registry-tls" not found
May 28 18:27:26.117823 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:26.117594    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls podName:2e4f5d47-c878-4f30-9531-19fc51e114ee nodeName:}" failed. No retries permitted until 2026-05-28 18:27:34.11757625 +0000 UTC m=+84.707185888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-npm74" (UID: "2e4f5d47-c878-4f30-9531-19fc51e114ee") : secret "insights-runtime-extractor-tls" not found
May 28 18:27:26.117823 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:26.117628    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls podName:fa808ccb-b32f-4354-be47-a083d2122da2 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:42.117620957 +0000 UTC m=+92.707230575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls") pod "image-registry-bd99bc869-rrcr2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2") : secret "image-registry-tls" not found
May 28 18:27:31.008129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:31.008100    2562 scope.go:117] "RemoveContainer" containerID="bf56395fc8c891037b785deec868d160d7ff83fd65ecca95d72c0871259782b3"
May 28 18:27:31.332563 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:31.332490    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:27:31.332896 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:31.332882    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/1.log"
May 28 18:27:31.332975 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:31.332913    2562 generic.go:358] "Generic (PLEG): container finished" podID="94c9365b-36fc-49e8-b3d2-71b861c649ec" containerID="01d352f29c6b39359667ec861e03cdf4611835e6a12f3511f25f80749f72a3a1" exitCode=255
May 28 18:27:31.333012 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:31.332974    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7" event={"ID":"94c9365b-36fc-49e8-b3d2-71b861c649ec","Type":"ContainerDied","Data":"01d352f29c6b39359667ec861e03cdf4611835e6a12f3511f25f80749f72a3a1"}
May 28 18:27:31.333012 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:31.333005    2562 scope.go:117] "RemoveContainer" containerID="bf56395fc8c891037b785deec868d160d7ff83fd65ecca95d72c0871259782b3"
May 28 18:27:31.333315 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:31.333297    2562 scope.go:117] "RemoveContainer" containerID="01d352f29c6b39359667ec861e03cdf4611835e6a12f3511f25f80749f72a3a1"
May 28 18:27:31.333522 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:31.333499    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-fbgk7_openshift-console-operator(94c9365b-36fc-49e8-b3d2-71b861c649ec)\"" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7" podUID="94c9365b-36fc-49e8-b3d2-71b861c649ec"
May 28 18:27:32.336296 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:32.336268    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:27:32.978245 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:32.978203    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:32.980599 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:32.980577    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad16d484-f1e3-4e9b-89a0-da6c330f9599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-6bcbt\" (UID: \"ad16d484-f1e3-4e9b-89a0-da6c330f9599\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:33.079196 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:33.079150    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:33.079385 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:33.079227    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:33.079808 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:33.079788    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67135a28-9521-483e-ac94-3afffb5e478f-service-ca-bundle\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:33.081527 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:33.081505    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67135a28-9521-483e-ac94-3afffb5e478f-metrics-certs\") pod \"router-default-7ccdf994fb-rbxch\" (UID: \"67135a28-9521-483e-ac94-3afffb5e478f\") " pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:33.216508 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:33.216467    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vnzjl\""
May 28 18:27:33.225371 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:33.225342    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"
May 28 18:27:33.230940 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:33.230882    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nb29l\""
May 28 18:27:33.238818 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:33.238793    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:33.357856 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:33.357826    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt"]
May 28 18:27:33.361051 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:33.361021    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad16d484_f1e3_4e9b_89a0_da6c330f9599.slice/crio-0fef3e01c8ce016f27def16ca08caf32dfe914c4e19cf6c715e9eb18135f66df WatchSource:0}: Error finding container 0fef3e01c8ce016f27def16ca08caf32dfe914c4e19cf6c715e9eb18135f66df: Status 404 returned error can't find the container with id 0fef3e01c8ce016f27def16ca08caf32dfe914c4e19cf6c715e9eb18135f66df
May 28 18:27:33.375386 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:33.375354    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7ccdf994fb-rbxch"]
May 28 18:27:33.377975 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:33.377945    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67135a28_9521_483e_ac94_3afffb5e478f.slice/crio-8334c7315189acb45fa386e387a899f4a45332a99d307d087662c8dc19cc20a0 WatchSource:0}: Error finding container 8334c7315189acb45fa386e387a899f4a45332a99d307d087662c8dc19cc20a0: Status 404 returned error can't find the container with id 8334c7315189acb45fa386e387a899f4a45332a99d307d087662c8dc19cc20a0
May 28 18:27:34.189703 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:34.189657    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:34.192423 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:34.192397    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4f5d47-c878-4f30-9531-19fc51e114ee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npm74\" (UID: \"2e4f5d47-c878-4f30-9531-19fc51e114ee\") " pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:34.325969 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:34.325928    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-npm74"
May 28 18:27:34.343264 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:34.343229    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt" event={"ID":"ad16d484-f1e3-4e9b-89a0-da6c330f9599","Type":"ContainerStarted","Data":"0fef3e01c8ce016f27def16ca08caf32dfe914c4e19cf6c715e9eb18135f66df"}
May 28 18:27:34.365743 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:34.347393    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7ccdf994fb-rbxch" event={"ID":"67135a28-9521-483e-ac94-3afffb5e478f","Type":"ContainerStarted","Data":"46147cb95a8ff6e72540b8af3b32855c625c1b1f7b436a1630f4fcd18a5a010a"}
May 28 18:27:34.365743 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:34.347453    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7ccdf994fb-rbxch" event={"ID":"67135a28-9521-483e-ac94-3afffb5e478f","Type":"ContainerStarted","Data":"8334c7315189acb45fa386e387a899f4a45332a99d307d087662c8dc19cc20a0"}
May 28 18:27:34.383352 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:34.383289    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7ccdf994fb-rbxch" podStartSLOduration=33.383269167 podStartE2EDuration="33.383269167s" podCreationTimestamp="2026-05-28 18:27:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:27:34.382076856 +0000 UTC m=+84.971686498" watchObservedRunningTime="2026-05-28 18:27:34.383269167 +0000 UTC m=+84.972878810"
May 28 18:27:34.487163 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:34.487081    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-npm74"]
May 28 18:27:34.490688 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:34.490643    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4f5d47_c878_4f30_9531_19fc51e114ee.slice/crio-33a915932431e4f453c6af6585b0872cda526aa0f8b57a2faacc371a82797e3a WatchSource:0}: Error finding container 33a915932431e4f453c6af6585b0872cda526aa0f8b57a2faacc371a82797e3a: Status 404 returned error can't find the container with id 33a915932431e4f453c6af6585b0872cda526aa0f8b57a2faacc371a82797e3a
May 28 18:27:35.240022 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:35.239989    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:35.242607 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:35.242581    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:35.351859 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:35.351764    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt" event={"ID":"ad16d484-f1e3-4e9b-89a0-da6c330f9599","Type":"ContainerStarted","Data":"9663ca826e22416b1a0e1bbef504e21d0c7cd493faac701f57acde72afe1e934"}
May 28 18:27:35.353168 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:35.353140    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npm74" event={"ID":"2e4f5d47-c878-4f30-9531-19fc51e114ee","Type":"ContainerStarted","Data":"b047d2e9c5f570fea313a66f052338ad8571b77843be2873cb6353e758f83531"}
May 28 18:27:35.353292 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:35.353193    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npm74" event={"ID":"2e4f5d47-c878-4f30-9531-19fc51e114ee","Type":"ContainerStarted","Data":"33a915932431e4f453c6af6585b0872cda526aa0f8b57a2faacc371a82797e3a"}
May 28 18:27:35.353373 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:35.353360    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:35.354546 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:35.354525    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7ccdf994fb-rbxch"
May 28 18:27:35.375910 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:35.375867    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-6bcbt" podStartSLOduration=32.64848934 podStartE2EDuration="34.375855391s" podCreationTimestamp="2026-05-28 18:27:01 +0000 UTC" firstStartedPulling="2026-05-28 18:27:33.36295287 +0000 UTC m=+83.952562492" lastFinishedPulling="2026-05-28 18:27:35.090318922 +0000 UTC m=+85.679928543" observedRunningTime="2026-05-28 18:27:35.375127692 +0000 UTC m=+85.964737333" watchObservedRunningTime="2026-05-28 18:27:35.375855391 +0000 UTC m=+85.965465031"
May 28 18:27:36.358136 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:36.358098    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npm74" event={"ID":"2e4f5d47-c878-4f30-9531-19fc51e114ee","Type":"ContainerStarted","Data":"3fef11eff972b0e2a0a970788235eceed6909678621ce613536abd4668784553"}
May 28 18:27:37.362648 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:37.362612    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npm74" event={"ID":"2e4f5d47-c878-4f30-9531-19fc51e114ee","Type":"ContainerStarted","Data":"3b2ae6aeb26e76f28e3ebefde019ff277594f549b800cef479862443bbfdce6a"}
May 28 18:27:37.378158 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:37.378113    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-npm74" podStartSLOduration=17.066838608 podStartE2EDuration="19.378099914s" podCreationTimestamp="2026-05-28 18:27:18 +0000 UTC" firstStartedPulling="2026-05-28 18:27:34.571654858 +0000 UTC m=+85.161264481" lastFinishedPulling="2026-05-28 18:27:36.882916168 +0000 UTC m=+87.472525787" observedRunningTime="2026-05-28 18:27:37.377819432 +0000 UTC m=+87.967429076" watchObservedRunningTime="2026-05-28 18:27:37.378099914 +0000 UTC m=+87.967709554"
May 28 18:27:39.032104 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:39.032051    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:39.034432 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:39.034410    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c95e253e-3420-45bf-ae6d-35db3b729ff9-samples-operator-tls\") pod \"cluster-samples-operator-697587599-zcsbs\" (UID: \"c95e253e-3420-45bf-ae6d-35db3b729ff9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:39.200263 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:39.200231    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5ghzs\""
May 28 18:27:39.208380 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:39.208363    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"
May 28 18:27:39.332232 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:39.332202    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs"]
May 28 18:27:39.361943 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:39.361922    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:39.362042 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:39.361950    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:27:39.362330 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:39.362317    2562 scope.go:117] "RemoveContainer" containerID="01d352f29c6b39359667ec861e03cdf4611835e6a12f3511f25f80749f72a3a1"
May 28 18:27:39.362496 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:39.362481    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-fbgk7_openshift-console-operator(94c9365b-36fc-49e8-b3d2-71b861c649ec)\"" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7" podUID="94c9365b-36fc-49e8-b3d2-71b861c649ec"
May 28 18:27:40.372270 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:40.372228    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs" event={"ID":"c95e253e-3420-45bf-ae6d-35db3b729ff9","Type":"ContainerStarted","Data":"0792a71106dd4a575d61b2e91016c2d0e3e2240d00967f685c1da33ff4992cb9"}
May 28 18:27:40.705206 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:40.705175    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bd99bc869-rrcr2"]
May 28 18:27:40.705412 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:40.705393    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-bd99bc869-rrcr2" podUID="fa808ccb-b32f-4354-be47-a083d2122da2"
May 28 18:27:41.376195 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.376161    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:41.376195 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.376171    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs" event={"ID":"c95e253e-3420-45bf-ae6d-35db3b729ff9","Type":"ContainerStarted","Data":"bf105a0f8fa720c2ad6dc1dd1669d1820faa140380b12371b1496b44f0512925"}
May 28 18:27:41.376634 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.376216    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs" event={"ID":"c95e253e-3420-45bf-ae6d-35db3b729ff9","Type":"ContainerStarted","Data":"27e0939d981f925d9b69086c4a440b23aeeb8090cd60cdba4e769c1040352031"}
May 28 18:27:41.380081 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.380060    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:41.394289 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.394241    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-zcsbs" podStartSLOduration=32.562049904 podStartE2EDuration="34.394229106s" podCreationTimestamp="2026-05-28 18:27:07 +0000 UTC" firstStartedPulling="2026-05-28 18:27:39.376075542 +0000 UTC m=+89.965685165" lastFinishedPulling="2026-05-28 18:27:41.208254748 +0000 UTC m=+91.797864367" observedRunningTime="2026-05-28 18:27:41.393312787 +0000 UTC m=+91.982922425" watchObservedRunningTime="2026-05-28 18:27:41.394229106 +0000 UTC m=+91.983838746"
May 28 18:27:41.551635 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.551545    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-bound-sa-token\") pod \"fa808ccb-b32f-4354-be47-a083d2122da2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") "
May 28 18:27:41.551635 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.551609    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-registry-certificates\") pod \"fa808ccb-b32f-4354-be47-a083d2122da2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") "
May 28 18:27:41.551635 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.551629    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-trusted-ca\") pod \"fa808ccb-b32f-4354-be47-a083d2122da2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") "
May 28 18:27:41.551927 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.551649    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-image-registry-private-configuration\") pod \"fa808ccb-b32f-4354-be47-a083d2122da2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") "
May 28 18:27:41.551927 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.551676    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa808ccb-b32f-4354-be47-a083d2122da2-ca-trust-extracted\") pod \"fa808ccb-b32f-4354-be47-a083d2122da2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") "
May 28 18:27:41.551927 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.551715    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjstn\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-kube-api-access-qjstn\") pod \"fa808ccb-b32f-4354-be47-a083d2122da2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") "
May 28 18:27:41.551927 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.551776    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-installation-pull-secrets\") pod \"fa808ccb-b32f-4354-be47-a083d2122da2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") "
May 28 18:27:41.552118 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.552006    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa808ccb-b32f-4354-be47-a083d2122da2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fa808ccb-b32f-4354-be47-a083d2122da2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:27:41.552118 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.552047    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fa808ccb-b32f-4354-be47-a083d2122da2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:27:41.552383 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.552355    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fa808ccb-b32f-4354-be47-a083d2122da2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:27:41.553988 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.553964    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-kube-api-access-qjstn" (OuterVolumeSpecName: "kube-api-access-qjstn") pod "fa808ccb-b32f-4354-be47-a083d2122da2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2"). InnerVolumeSpecName "kube-api-access-qjstn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:27:41.554092 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.554066    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fa808ccb-b32f-4354-be47-a083d2122da2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:27:41.554140 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.554099    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fa808ccb-b32f-4354-be47-a083d2122da2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:27:41.554173 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.554143    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fa808ccb-b32f-4354-be47-a083d2122da2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:27:41.652794 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.652757    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-bound-sa-token\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:27:41.652794 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.652788    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-registry-certificates\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:27:41.652794 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.652798    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa808ccb-b32f-4354-be47-a083d2122da2-trusted-ca\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:27:41.653014 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.652808    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-image-registry-private-configuration\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:27:41.653014 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.652819    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa808ccb-b32f-4354-be47-a083d2122da2-ca-trust-extracted\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:27:41.653014 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.652828    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjstn\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-kube-api-access-qjstn\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:27:41.653014 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:41.652837    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa808ccb-b32f-4354-be47-a083d2122da2-installation-pull-secrets\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:27:42.157053 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:42.157009    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:42.159334 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:42.159306    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls\") pod \"image-registry-bd99bc869-rrcr2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") " pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:42.257712 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:42.257673    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls\") pod \"fa808ccb-b32f-4354-be47-a083d2122da2\" (UID: \"fa808ccb-b32f-4354-be47-a083d2122da2\") "
May 28 18:27:42.259706 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:42.259679    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fa808ccb-b32f-4354-be47-a083d2122da2" (UID: "fa808ccb-b32f-4354-be47-a083d2122da2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:27:42.359002 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:42.358915    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa808ccb-b32f-4354-be47-a083d2122da2-registry-tls\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:27:42.382376 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:42.379840    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bd99bc869-rrcr2"
May 28 18:27:42.412584 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:42.412556    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bd99bc869-rrcr2"]
May 28 18:27:42.417055 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:42.417029    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bd99bc869-rrcr2"]
May 28 18:27:43.685434 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.685403    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"]
May 28 18:27:43.688430 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.688414    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:43.691238 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.691203    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w6hgd\""
May 28 18:27:43.691369 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.691233    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 28 18:27:43.691369 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.691237    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 18:27:43.691369 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.691209    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 28 18:27:43.698063 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.698043    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"]
May 28 18:27:43.872305 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.872263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4029e8cc-af77-4af5-9e3f-7a4122c81f50-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:43.872305 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.872308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4029e8cc-af77-4af5-9e3f-7a4122c81f50-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:43.872509 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.872383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4029e8cc-af77-4af5-9e3f-7a4122c81f50-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:43.872509 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.872432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42xm7\" (UniqueName: \"kubernetes.io/projected/4029e8cc-af77-4af5-9e3f-7a4122c81f50-kube-api-access-42xm7\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:43.973704 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.973674    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4029e8cc-af77-4af5-9e3f-7a4122c81f50-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:43.973869 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.973713    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42xm7\" (UniqueName: \"kubernetes.io/projected/4029e8cc-af77-4af5-9e3f-7a4122c81f50-kube-api-access-42xm7\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:43.973869 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.973818    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4029e8cc-af77-4af5-9e3f-7a4122c81f50-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:43.973869 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.973847    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4029e8cc-af77-4af5-9e3f-7a4122c81f50-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:43.973979 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:43.973940    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 28 18:27:43.974023 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:43.974011    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4029e8cc-af77-4af5-9e3f-7a4122c81f50-prometheus-operator-tls podName:4029e8cc-af77-4af5-9e3f-7a4122c81f50 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:44.473992733 +0000 UTC m=+95.063602368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/4029e8cc-af77-4af5-9e3f-7a4122c81f50-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-zhkdn" (UID: "4029e8cc-af77-4af5-9e3f-7a4122c81f50") : secret "prometheus-operator-tls" not found
May 28 18:27:43.974426 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.974406    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4029e8cc-af77-4af5-9e3f-7a4122c81f50-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:43.976334 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.976315    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4029e8cc-af77-4af5-9e3f-7a4122c81f50-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:43.983803 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:43.983775    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42xm7\" (UniqueName: \"kubernetes.io/projected/4029e8cc-af77-4af5-9e3f-7a4122c81f50-kube-api-access-42xm7\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:44.011734 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:44.011696    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa808ccb-b32f-4354-be47-a083d2122da2" path="/var/lib/kubelet/pods/fa808ccb-b32f-4354-be47-a083d2122da2/volumes"
May 28 18:27:44.478642 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:44.478608    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4029e8cc-af77-4af5-9e3f-7a4122c81f50-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:44.480985 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:44.480954    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4029e8cc-af77-4af5-9e3f-7a4122c81f50-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zhkdn\" (UID: \"4029e8cc-af77-4af5-9e3f-7a4122c81f50\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:44.597920 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:44.597871    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"
May 28 18:27:44.720644 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:44.720608    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn"]
May 28 18:27:44.723573 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:44.723549    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4029e8cc_af77_4af5_9e3f_7a4122c81f50.slice/crio-518ef14c843fb1df24f9ba3ade5045bf101bcf2a6f1387ddef702195dbbef2c6 WatchSource:0}: Error finding container 518ef14c843fb1df24f9ba3ade5045bf101bcf2a6f1387ddef702195dbbef2c6: Status 404 returned error can't find the container with id 518ef14c843fb1df24f9ba3ade5045bf101bcf2a6f1387ddef702195dbbef2c6
May 28 18:27:45.389218 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:45.389177    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn" event={"ID":"4029e8cc-af77-4af5-9e3f-7a4122c81f50","Type":"ContainerStarted","Data":"518ef14c843fb1df24f9ba3ade5045bf101bcf2a6f1387ddef702195dbbef2c6"}
May 28 18:27:47.201674 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.201644    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:27:47.201674 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.201686    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:27:47.203935 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.203909    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2f5e88e3-dd35-45b5-a7ea-4b387a9bc610-cert\") pod \"ingress-canary-vdvxl\" (UID: \"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610\") " pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:27:47.203935 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.203918    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e7c82257-ba41-41c3-abf9-d912f400b80a-metrics-tls\") pod \"dns-default-ccp2w\" (UID: \"e7c82257-ba41-41c3-abf9-d912f400b80a\") " pod="openshift-dns/dns-default-ccp2w"
May 28 18:27:47.396168 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.396125    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn" event={"ID":"4029e8cc-af77-4af5-9e3f-7a4122c81f50","Type":"ContainerStarted","Data":"356f1ee83f216b88c62e6e6271e68e3cf64ea414bc822141d6c9d0138cebdf00"}
May 28 18:27:47.396168 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.396170    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn" event={"ID":"4029e8cc-af77-4af5-9e3f-7a4122c81f50","Type":"ContainerStarted","Data":"7f0dc4c480f894c3d0d62de1e505e8e780e2a87bd714797f3a85f602a51c7ae9"}
May 28 18:27:47.411418 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.411343    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zhkdn" podStartSLOduration=2.658730602 podStartE2EDuration="4.411329409s" podCreationTimestamp="2026-05-28 18:27:43 +0000 UTC" firstStartedPulling="2026-05-28 18:27:44.72538424 +0000 UTC m=+95.314993860" lastFinishedPulling="2026-05-28 18:27:46.477983048 +0000 UTC m=+97.067592667" observedRunningTime="2026-05-28 18:27:47.410101675 +0000 UTC m=+97.999711316" watchObservedRunningTime="2026-05-28 18:27:47.411329409 +0000 UTC m=+98.000939050"
May 28 18:27:47.478312 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.478231    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2d7l\""
May 28 18:27:47.487196 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.487173    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ccp2w"
May 28 18:27:47.494816 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.494796    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lsslr\""
May 28 18:27:47.503503 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.503473    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vdvxl"
May 28 18:27:47.620234 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.620205    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ccp2w"]
May 28 18:27:47.623274 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:47.623241    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c82257_ba41_41c3_abf9_d912f400b80a.slice/crio-9bfc760bf0d3ee93125cf97d75deb826a60cc21afecec29aa7c6d22736532cb4 WatchSource:0}: Error finding container 9bfc760bf0d3ee93125cf97d75deb826a60cc21afecec29aa7c6d22736532cb4: Status 404 returned error can't find the container with id 9bfc760bf0d3ee93125cf97d75deb826a60cc21afecec29aa7c6d22736532cb4
May 28 18:27:47.640769 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:47.640745    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vdvxl"]
May 28 18:27:47.643651 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:47.643627    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f5e88e3_dd35_45b5_a7ea_4b387a9bc610.slice/crio-b14eda373fe95328d7f26030018c8d3f2c96af15cd465aeb44b13b5b7c8f2de1 WatchSource:0}: Error finding container b14eda373fe95328d7f26030018c8d3f2c96af15cd465aeb44b13b5b7c8f2de1: Status 404 returned error can't find the container with id b14eda373fe95328d7f26030018c8d3f2c96af15cd465aeb44b13b5b7c8f2de1
May 28 18:27:48.400446 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:48.400394    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ccp2w" event={"ID":"e7c82257-ba41-41c3-abf9-d912f400b80a","Type":"ContainerStarted","Data":"9bfc760bf0d3ee93125cf97d75deb826a60cc21afecec29aa7c6d22736532cb4"}
May 28 18:27:48.401878 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:48.401847    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vdvxl" event={"ID":"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610","Type":"ContainerStarted","Data":"b14eda373fe95328d7f26030018c8d3f2c96af15cd465aeb44b13b5b7c8f2de1"}
May 28 18:27:49.050183 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.050148    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bk7f7"]
May 28 18:27:49.065807 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.065775    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.067883 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.067852    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 18:27:49.068013 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.067961    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 18:27:49.068101 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.068086    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 18:27:49.068178 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.068146    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nsxzf\""
May 28 18:27:49.068356 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.068336    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"]
May 28 18:27:49.090106 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.090076    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"]
May 28 18:27:49.090285 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.090180    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.092771 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.092677    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 18:27:49.092976 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.092957    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 18:27:49.093094 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.093072    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 18:27:49.093166 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.093152    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tls49\""
May 28 18:27:49.221042 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-metrics-client-ca\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.221042 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-root\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.221288 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxlw4\" (UniqueName: \"kubernetes.io/projected/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-kube-api-access-hxlw4\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.221288 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.221288 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-sys\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.221425 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.221425 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-tls\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.221425 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9tcm\" (UniqueName: \"kubernetes.io/projected/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-api-access-p9tcm\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.221567 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-accelerators-collector-config\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.221567 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.221567 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-wtmp\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.221567 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3710f8f8-bb68-48b8-a843-6533f66610bd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.221567 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3710f8f8-bb68-48b8-a843-6533f66610bd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.221835 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-textfile\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.221835 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.221613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.306838 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.306756    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dswfb"
May 28 18:27:49.322666 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.322576    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-wtmp\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.322944 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.322701    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3710f8f8-bb68-48b8-a843-6533f66610bd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.322944 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.322774    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3710f8f8-bb68-48b8-a843-6533f66610bd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.322944 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.322806    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-wtmp\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.322944 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.322812    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-textfile\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.322944 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.322881    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.322944 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.322922    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-metrics-client-ca\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.323259 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.322947    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-root\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.323259 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.322971    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxlw4\" (UniqueName: \"kubernetes.io/projected/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-kube-api-access-hxlw4\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.323259 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323001    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.323259 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323069    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-root\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.323259 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323126    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-sys\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.323259 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323161    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.323259 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323204    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-tls\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.323259 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323236    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9tcm\" (UniqueName: \"kubernetes.io/projected/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-api-access-p9tcm\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.323656 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323297    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-textfile\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.323656 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323307    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-accelerators-collector-config\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.323656 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323348    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.323656 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:49.323388    2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 28 18:27:49.323656 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:27:49.323452    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-tls podName:3710f8f8-bb68-48b8-a843-6533f66610bd nodeName:}" failed. No retries permitted until 2026-05-28 18:27:49.823434771 +0000 UTC m=+100.413044391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-qnsnd" (UID: "3710f8f8-bb68-48b8-a843-6533f66610bd") : secret "kube-state-metrics-tls" not found
May 28 18:27:49.323656 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323601    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3710f8f8-bb68-48b8-a843-6533f66610bd-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.323984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323758    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-sys\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.324123 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.323312    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3710f8f8-bb68-48b8-a843-6533f66610bd-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.324123 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.324061    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.324123 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.324079    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-metrics-client-ca\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.324343 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.324270    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-accelerators-collector-config\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.326172 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.326143    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.326514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.326497    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-node-exporter-tls\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.326598 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.326576    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.335211 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.335152    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9tcm\" (UniqueName: \"kubernetes.io/projected/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-api-access-p9tcm\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.337516 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.337492    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxlw4\" (UniqueName: \"kubernetes.io/projected/b2dcc3c4-a954-40b8-864c-4dfd1db90f27-kube-api-access-hxlw4\") pod \"node-exporter-bk7f7\" (UID: \"b2dcc3c4-a954-40b8-864c-4dfd1db90f27\") " pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.375673 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.375634    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bk7f7"
May 28 18:27:49.638875 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:49.638824    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2dcc3c4_a954_40b8_864c_4dfd1db90f27.slice/crio-add9a68c25e60f0c218b6450e811e65f0739b6135eadfb9f4640b5f145e59762 WatchSource:0}: Error finding container add9a68c25e60f0c218b6450e811e65f0739b6135eadfb9f4640b5f145e59762: Status 404 returned error can't find the container with id add9a68c25e60f0c218b6450e811e65f0739b6135eadfb9f4640b5f145e59762
May 28 18:27:49.828476 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.828438    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.831133 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.831076    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3710f8f8-bb68-48b8-a843-6533f66610bd-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-qnsnd\" (UID: \"3710f8f8-bb68-48b8-a843-6533f66610bd\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:49.999061 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:49.999031    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"
May 28 18:27:50.163644 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:50.163609    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd"]
May 28 18:27:50.168398 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:50.168359    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3710f8f8_bb68_48b8_a843_6533f66610bd.slice/crio-e042c65265c9e9bc716e63b79b7652e68857b73338663bcba2e962ad3cd3dc77 WatchSource:0}: Error finding container e042c65265c9e9bc716e63b79b7652e68857b73338663bcba2e962ad3cd3dc77: Status 404 returned error can't find the container with id e042c65265c9e9bc716e63b79b7652e68857b73338663bcba2e962ad3cd3dc77
May 28 18:27:50.410091 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:50.409980    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ccp2w" event={"ID":"e7c82257-ba41-41c3-abf9-d912f400b80a","Type":"ContainerStarted","Data":"54d082919c50ffe651611bc845a43f8bf7308c637d0a94c5bba956381002112e"}
May 28 18:27:50.410091 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:50.410043    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ccp2w" event={"ID":"e7c82257-ba41-41c3-abf9-d912f400b80a","Type":"ContainerStarted","Data":"f41dbf486fb362e23f32e22b30270125f43b16e77dcab455ad1cb22a60b1886f"}
May 28 18:27:50.410318 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:50.410149    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ccp2w"
May 28 18:27:50.411232 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:50.411204    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bk7f7" event={"ID":"b2dcc3c4-a954-40b8-864c-4dfd1db90f27","Type":"ContainerStarted","Data":"add9a68c25e60f0c218b6450e811e65f0739b6135eadfb9f4640b5f145e59762"}
May 28 18:27:50.412854 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:50.412828    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vdvxl" event={"ID":"2f5e88e3-dd35-45b5-a7ea-4b387a9bc610","Type":"ContainerStarted","Data":"5971bc00e7f9af038309a0bcec487efbe1b0c1a257a3349722ac34993acd2423"}
May 28 18:27:50.414068 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:50.414042    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd" event={"ID":"3710f8f8-bb68-48b8-a843-6533f66610bd","Type":"ContainerStarted","Data":"e042c65265c9e9bc716e63b79b7652e68857b73338663bcba2e962ad3cd3dc77"}
May 28 18:27:50.427848 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:50.427790    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-ccp2w" podStartSLOduration=65.414813596 podStartE2EDuration="1m7.427772054s" podCreationTimestamp="2026-05-28 18:26:43 +0000 UTC" firstStartedPulling="2026-05-28 18:27:47.625317202 +0000 UTC m=+98.214926821" lastFinishedPulling="2026-05-28 18:27:49.638275647 +0000 UTC m=+100.227885279" observedRunningTime="2026-05-28 18:27:50.426283245 +0000 UTC m=+101.015892887" watchObservedRunningTime="2026-05-28 18:27:50.427772054 +0000 UTC m=+101.017381699"
May 28 18:27:50.443791 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:50.443703    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vdvxl" podStartSLOduration=65.447003592 podStartE2EDuration="1m7.443690008s" podCreationTimestamp="2026-05-28 18:26:43 +0000 UTC" firstStartedPulling="2026-05-28 18:27:47.645583576 +0000 UTC m=+98.235193195" lastFinishedPulling="2026-05-28 18:27:49.642269982 +0000 UTC m=+100.231879611" observedRunningTime="2026-05-28 18:27:50.443004177 +0000 UTC m=+101.032613818" watchObservedRunningTime="2026-05-28 18:27:50.443690008 +0000 UTC m=+101.033299650"
May 28 18:27:51.419388 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:51.419344    2562 generic.go:358] "Generic (PLEG): container finished" podID="b2dcc3c4-a954-40b8-864c-4dfd1db90f27" containerID="671039fb0ec8d3541b61bbb84d2b12955e55135d538b8fc1b14caf95440ac695" exitCode=0
May 28 18:27:51.419907 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:51.419433    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bk7f7" event={"ID":"b2dcc3c4-a954-40b8-864c-4dfd1db90f27","Type":"ContainerDied","Data":"671039fb0ec8d3541b61bbb84d2b12955e55135d538b8fc1b14caf95440ac695"}
May 28 18:27:52.424450 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:52.424403    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bk7f7" event={"ID":"b2dcc3c4-a954-40b8-864c-4dfd1db90f27","Type":"ContainerStarted","Data":"3e036f90e64ba88a888823ed2aa20bd4202b15d1cc349e2be34497019479e5dd"}
May 28 18:27:52.424450 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:52.424446    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bk7f7" event={"ID":"b2dcc3c4-a954-40b8-864c-4dfd1db90f27","Type":"ContainerStarted","Data":"963cbfb8ec69d3b6ae9319168088f965392b1f078318da8c59e674f4b1d40bda"}
May 28 18:27:52.426273 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:52.426243    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd" event={"ID":"3710f8f8-bb68-48b8-a843-6533f66610bd","Type":"ContainerStarted","Data":"4f5ee6c279c2f083d42ae25ea08d43134091bd24086ebb4dbe83b4ae95f8dcba"}
May 28 18:27:52.426273 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:52.426273    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd" event={"ID":"3710f8f8-bb68-48b8-a843-6533f66610bd","Type":"ContainerStarted","Data":"f4993cdd0b28afad00d1c6be0243f5c1e0862ab8f668ef102bf8b56239808275"}
May 28 18:27:52.426425 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:52.426283    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd" event={"ID":"3710f8f8-bb68-48b8-a843-6533f66610bd","Type":"ContainerStarted","Data":"399add827afc3f29fa53c00fc5dfa8dbbae572103892a0200e09910b4275b895"}
May 28 18:27:52.442472 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:52.442414    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bk7f7" podStartSLOduration=2.547963995 podStartE2EDuration="3.44239754s" podCreationTimestamp="2026-05-28 18:27:49 +0000 UTC" firstStartedPulling="2026-05-28 18:27:49.640552016 +0000 UTC m=+100.230161635" lastFinishedPulling="2026-05-28 18:27:50.534985546 +0000 UTC m=+101.124595180" observedRunningTime="2026-05-28 18:27:52.44162188 +0000 UTC m=+103.031231521" watchObservedRunningTime="2026-05-28 18:27:52.44239754 +0000 UTC m=+103.032007182"
May 28 18:27:52.459377 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:52.459329    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-qnsnd" podStartSLOduration=2.159037066 podStartE2EDuration="3.459314223s" podCreationTimestamp="2026-05-28 18:27:49 +0000 UTC" firstStartedPulling="2026-05-28 18:27:50.171016333 +0000 UTC m=+100.760625957" lastFinishedPulling="2026-05-28 18:27:51.471293481 +0000 UTC m=+102.060903114" observedRunningTime="2026-05-28 18:27:52.457887426 +0000 UTC m=+103.047497079" watchObservedRunningTime="2026-05-28 18:27:52.459314223 +0000 UTC m=+103.048923864"
May 28 18:27:53.008366 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.008325    2562 scope.go:117] "RemoveContainer" containerID="01d352f29c6b39359667ec861e03cdf4611835e6a12f3511f25f80749f72a3a1"
May 28 18:27:53.430952 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.430874    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:27:53.431387 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.431020    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7" event={"ID":"94c9365b-36fc-49e8-b3d2-71b861c649ec","Type":"ContainerStarted","Data":"a44fefe7a03445c4246964048d1e50c669f4ffb18658bfd981cea27b857d069f"}
May 28 18:27:53.446777 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.446713    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7" podStartSLOduration=42.173702881 podStartE2EDuration="44.446698778s" podCreationTimestamp="2026-05-28 18:27:09 +0000 UTC" firstStartedPulling="2026-05-28 18:27:09.500412474 +0000 UTC m=+60.090022106" lastFinishedPulling="2026-05-28 18:27:11.773408381 +0000 UTC m=+62.363018003" observedRunningTime="2026-05-28 18:27:53.445855771 +0000 UTC m=+104.035465423" watchObservedRunningTime="2026-05-28 18:27:53.446698778 +0000 UTC m=+104.036308418"
May 28 18:27:53.473982 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.473944    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-fd9988574-6j2md"]
May 28 18:27:53.476441 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.476415    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.478950 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.478922    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 18:27:53.479101 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.478998    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 28 18:27:53.479101 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.479064    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 28 18:27:53.479221 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.479120    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-edmv54tf6p7f1\""
May 28 18:27:53.479221 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.479192    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 28 18:27:53.479221 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.479073    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-79dll\""
May 28 18:27:53.488865 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.488836    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fd9988574-6j2md"]
May 28 18:27:53.560164 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.560122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvjgs\" (UniqueName: \"kubernetes.io/projected/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-kube-api-access-mvjgs\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.560350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.560181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-audit-log\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.560350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.560231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-secret-metrics-server-tls\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.560350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.560258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-secret-metrics-server-client-certs\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.560350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.560298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-metrics-server-audit-profiles\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.560556 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.560362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.560556 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.560405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-client-ca-bundle\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.660996 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.660960    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.661194 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.661025    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-client-ca-bundle\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.661194 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.661057    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvjgs\" (UniqueName: \"kubernetes.io/projected/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-kube-api-access-mvjgs\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.661194 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.661115    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-audit-log\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.661194 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.661174    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-secret-metrics-server-tls\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.661426 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.661202    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-secret-metrics-server-client-certs\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.661426 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.661361    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-metrics-server-audit-profiles\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.661891 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.661829    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.661891 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.661829    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-audit-log\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.662398 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.662371    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-metrics-server-audit-profiles\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.664117 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.664073    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-secret-metrics-server-tls\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.664863 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.664838    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-client-ca-bundle\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.665006 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.664941    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-secret-metrics-server-client-certs\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.669440 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.669416    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvjgs\" (UniqueName: \"kubernetes.io/projected/c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d-kube-api-access-mvjgs\") pod \"metrics-server-fd9988574-6j2md\" (UID: \"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d\") " pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.786681 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.786644    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:27:53.923869 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:53.923830    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-fd9988574-6j2md"]
May 28 18:27:53.931815 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:27:53.931745    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9dac9a2_b3ee_4a4b_ab18_8c07eefe7c2d.slice/crio-94f3397db87e79da042fcf6aad4b6620cc8520e655459669fe576c3d555a177d WatchSource:0}: Error finding container 94f3397db87e79da042fcf6aad4b6620cc8520e655459669fe576c3d555a177d: Status 404 returned error can't find the container with id 94f3397db87e79da042fcf6aad4b6620cc8520e655459669fe576c3d555a177d
May 28 18:27:54.435685 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:54.435649    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fd9988574-6j2md" event={"ID":"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d","Type":"ContainerStarted","Data":"94f3397db87e79da042fcf6aad4b6620cc8520e655459669fe576c3d555a177d"}
May 28 18:27:55.288760 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.286608    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 18:27:55.290712 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.290679    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.292866 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.292771    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 18:27:55.292994 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.292900    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 18:27:55.293074 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.293053    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 18:27:55.293171 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.293155    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 18:27:55.293248 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.293203    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 18:27:55.293248 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.293162    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 18:27:55.293834 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.293588    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 18:27:55.293834 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.293669    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 18:27:55.293834 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.293741    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 18:27:55.293834 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.293751    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 18:27:55.294052 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.293840    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8vqvj\""
May 28 18:27:55.294113 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.294095    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 18:27:55.295035 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.294752    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fuir185jlv0gj\""
May 28 18:27:55.296379 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.296357    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 18:27:55.305705 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.304519    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 18:27:55.375233 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375233 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375470 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375470 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375470 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375470 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375470 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375465    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375714 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375714 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-config-out\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375714 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kkzr\" (UniqueName: \"kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-kube-api-access-8kkzr\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375714 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375648    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-config\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375714 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375772    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-web-config\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.375984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.375915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.477292 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.477223    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.477918 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.477830    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478276    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478327    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478373    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478410    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478441    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478492    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478539    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-config-out\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478570    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8kkzr\" (UniqueName: \"kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-kube-api-access-8kkzr\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478611    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-config\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478645    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478652    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478710    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478768    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478834    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-web-config\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478862    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478890    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.479514 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.478924    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.480468 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.479376    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.482373 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.482347    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.484995 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.484110    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.486441 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.485696    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.486441 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.486390    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.487201 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.486803    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-config-out\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.487201 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.487101    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-web-config\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.487201 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.487160    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.487201 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.487165    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.487464 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.487435    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.488360 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.488307    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-config\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.488457 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.488395    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.488975 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.488926    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.489608 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.489578    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.490006 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.489981    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.490391 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.490371    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.490576 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.490556    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kkzr\" (UniqueName: \"kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-kube-api-access-8kkzr\") pod \"prometheus-k8s-0\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.606570 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.606529    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:27:55.770362 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:55.770268    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 18:27:56.444071 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:56.444030    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerStarted","Data":"8e66cfba0e742d11b12c7ba12fb6cbc615c6ba5f95a705b23d18f40cb7b7dfba"}
May 28 18:27:56.445492 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:56.445461    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-fd9988574-6j2md" event={"ID":"c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d","Type":"ContainerStarted","Data":"27616a76b6ed842a57c0699d8c7e4d2c0886e5b3973acfb5c2a429eb7314150c"}
May 28 18:27:56.463135 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:56.463080    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-fd9988574-6j2md" podStartSLOduration=1.795940206 podStartE2EDuration="3.463067465s" podCreationTimestamp="2026-05-28 18:27:53 +0000 UTC" firstStartedPulling="2026-05-28 18:27:53.933785858 +0000 UTC m=+104.523395479" lastFinishedPulling="2026-05-28 18:27:55.600913105 +0000 UTC m=+106.190522738" observedRunningTime="2026-05-28 18:27:56.46242654 +0000 UTC m=+107.052036182" watchObservedRunningTime="2026-05-28 18:27:56.463067465 +0000 UTC m=+107.052677106"
May 28 18:27:57.449443 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:57.449404    2562 generic.go:358] "Generic (PLEG): container finished" podID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerID="61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717" exitCode=0
May 28 18:27:57.449856 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:27:57.449487    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerDied","Data":"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"}
May 28 18:28:00.423400 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:00.423360    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ccp2w"
May 28 18:28:01.464642 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:01.464604    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerStarted","Data":"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"}
May 28 18:28:01.464642 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:01.464646    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerStarted","Data":"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"}
May 28 18:28:03.431519 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:03.431479    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:28:03.435248 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:03.435221    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-fbgk7"
May 28 18:28:03.473051 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:03.473016    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerStarted","Data":"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"}
May 28 18:28:03.473051 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:03.473056    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerStarted","Data":"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"}
May 28 18:28:03.473282 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:03.473068    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerStarted","Data":"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"}
May 28 18:28:03.473282 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:03.473076    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerStarted","Data":"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"}
May 28 18:28:03.498651 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:03.498338    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.823716577 podStartE2EDuration="8.498317785s" podCreationTimestamp="2026-05-28 18:27:55 +0000 UTC" firstStartedPulling="2026-05-28 18:27:55.781171592 +0000 UTC m=+106.370781211" lastFinishedPulling="2026-05-28 18:28:02.455772786 +0000 UTC m=+113.045382419" observedRunningTime="2026-05-28 18:28:03.496833233 +0000 UTC m=+114.086442876" watchObservedRunningTime="2026-05-28 18:28:03.498317785 +0000 UTC m=+114.087927427"
May 28 18:28:05.607158 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:05.607119    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:28:13.787105 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:13.787071    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:28:13.787105 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:13.787111    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:28:18.807701 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:18.807657    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:28:18.810062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:18.810040    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26b71d0c-8000-421e-b031-4805782b9c85-metrics-certs\") pod \"network-metrics-daemon-2jrmq\" (UID: \"26b71d0c-8000-421e-b031-4805782b9c85\") " pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:28:18.925120 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:18.925083    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-whbnm\""
May 28 18:28:18.933129 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:18.933100    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2jrmq"
May 28 18:28:19.070993 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:19.070967    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2jrmq"]
May 28 18:28:19.073562 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:28:19.073526    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b71d0c_8000_421e_b031_4805782b9c85.slice/crio-46e876b3fcf4fa71ca6d2abf149808f2b86ce2d436aa31e9ba4b33b26319f1dc WatchSource:0}: Error finding container 46e876b3fcf4fa71ca6d2abf149808f2b86ce2d436aa31e9ba4b33b26319f1dc: Status 404 returned error can't find the container with id 46e876b3fcf4fa71ca6d2abf149808f2b86ce2d436aa31e9ba4b33b26319f1dc
May 28 18:28:19.523429 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:19.523392    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jrmq" event={"ID":"26b71d0c-8000-421e-b031-4805782b9c85","Type":"ContainerStarted","Data":"46e876b3fcf4fa71ca6d2abf149808f2b86ce2d436aa31e9ba4b33b26319f1dc"}
May 28 18:28:20.528552 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:20.528516    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jrmq" event={"ID":"26b71d0c-8000-421e-b031-4805782b9c85","Type":"ContainerStarted","Data":"3e0cfd1d13fd6a2b4f6f61b2a08f6fa27f5d92ed7cb34bcf3430a7921e673a51"}
May 28 18:28:20.528552 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:20.528555    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2jrmq" event={"ID":"26b71d0c-8000-421e-b031-4805782b9c85","Type":"ContainerStarted","Data":"f682d0ce3adf30b7ac2da038bc72cdb236dc81d0190fce7a9770df1d8c82bee9"}
May 28 18:28:20.544173 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:20.544121    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2jrmq" podStartSLOduration=129.553391849 podStartE2EDuration="2m10.544100949s" podCreationTimestamp="2026-05-28 18:26:10 +0000 UTC" firstStartedPulling="2026-05-28 18:28:19.07544109 +0000 UTC m=+129.665050710" lastFinishedPulling="2026-05-28 18:28:20.066150192 +0000 UTC m=+130.655759810" observedRunningTime="2026-05-28 18:28:20.543136879 +0000 UTC m=+131.132746542" watchObservedRunningTime="2026-05-28 18:28:20.544100949 +0000 UTC m=+131.133710591"
May 28 18:28:33.792959 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:33.792928    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:28:33.796887 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:33.796864    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-fd9988574-6j2md"
May 28 18:28:34.572867 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:34.572782    2562 generic.go:358] "Generic (PLEG): container finished" podID="67fa7b8d-2757-4384-bf17-9f9b50060d25" containerID="f4904142ae5145032a14cb0412a9016fa3a3d5627bab4af84e98992850e44014" exitCode=0
May 28 18:28:34.573146 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:34.572827    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-lzjbq" event={"ID":"67fa7b8d-2757-4384-bf17-9f9b50060d25","Type":"ContainerDied","Data":"f4904142ae5145032a14cb0412a9016fa3a3d5627bab4af84e98992850e44014"}
May 28 18:28:34.573904 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:34.573642    2562 scope.go:117] "RemoveContainer" containerID="f4904142ae5145032a14cb0412a9016fa3a3d5627bab4af84e98992850e44014"
May 28 18:28:35.578186 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:35.578148    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-lzjbq" event={"ID":"67fa7b8d-2757-4384-bf17-9f9b50060d25","Type":"ContainerStarted","Data":"1792607e78619aa7b6cfc0f4bd9339d5bf82aa4621d1da56d679d8d1368b2471"}
May 28 18:28:35.579381 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:35.579357    2562 generic.go:358] "Generic (PLEG): container finished" podID="c3454ad1-f3d5-47c0-a890-522f6aa4d173" containerID="03f131f83fe1ec7b83b33e5af2354be80f0379decc2f3f6baed0a7eff52e7f00" exitCode=0
May 28 18:28:35.579449 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:35.579401    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb" event={"ID":"c3454ad1-f3d5-47c0-a890-522f6aa4d173","Type":"ContainerDied","Data":"03f131f83fe1ec7b83b33e5af2354be80f0379decc2f3f6baed0a7eff52e7f00"}
May 28 18:28:35.579687 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:35.579674    2562 scope.go:117] "RemoveContainer" containerID="03f131f83fe1ec7b83b33e5af2354be80f0379decc2f3f6baed0a7eff52e7f00"
May 28 18:28:36.583558 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:36.583527    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-656pb" event={"ID":"c3454ad1-f3d5-47c0-a890-522f6aa4d173","Type":"ContainerStarted","Data":"4f80d5e4dadf25152d629c0dc268acb7aed0e773106b71f13fbe86b75172ad61"}
May 28 18:28:41.597827 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:41.597789    2562 generic.go:358] "Generic (PLEG): container finished" podID="e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae" containerID="969481bd54fd4dd4dfe7efe1d05205dd9d1ab0070e256c70ed0b2f8669de2f67" exitCode=0
May 28 18:28:41.598189 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:41.597865    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw" event={"ID":"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae","Type":"ContainerDied","Data":"969481bd54fd4dd4dfe7efe1d05205dd9d1ab0070e256c70ed0b2f8669de2f67"}
May 28 18:28:41.598189 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:41.598178    2562 scope.go:117] "RemoveContainer" containerID="969481bd54fd4dd4dfe7efe1d05205dd9d1ab0070e256c70ed0b2f8669de2f67"
May 28 18:28:42.602872 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:42.602835    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-ldxnw" event={"ID":"e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae","Type":"ContainerStarted","Data":"3b878e03599c5639e87233ecee608fc9a4e8a472f94f2bf9110464c793219dbf"}
May 28 18:28:55.607373 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:55.607336    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:28:55.623465 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:55.623438    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:28:55.659698 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:28:55.659668    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:13.700449 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:13.700368    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 18:29:13.701051 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:13.701012    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="prometheus" containerID="cri-o://8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc" gracePeriod=600
May 28 18:29:13.701290 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:13.701040    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy" containerID="cri-o://514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf" gracePeriod=600
May 28 18:29:13.701392 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:13.701028    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="thanos-sidecar" containerID="cri-o://3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44" gracePeriod=600
May 28 18:29:13.701392 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:13.701029    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy-web" containerID="cri-o://0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048" gracePeriod=600
May 28 18:29:13.701392 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:13.701069    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="config-reloader" containerID="cri-o://11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39" gracePeriod=600
May 28 18:29:13.701538 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:13.701036    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769" gracePeriod=600
May 28 18:29:13.971524 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:13.971499    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.091332 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091288    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-kube-rbac-proxy\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.091332 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091337    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-metrics-client-certs\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.091593 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091356    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-metrics-client-ca\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.091593 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091383    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kkzr\" (UniqueName: \"kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-kube-api-access-8kkzr\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.091593 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091412    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-rulefiles-0\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.091593 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091436    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-web-config\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.091593 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091455    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-tls\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.091593 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091481    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.091593 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091513    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-db\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.091593 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091535    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-config\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.091593 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091567    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-config-out\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.091593 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091598    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-serving-certs-ca-bundle\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.092112 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091622    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-thanos-prometheus-http-client-file\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.092112 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091653    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-grpc-tls\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.092112 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091689    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.092112 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091755    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-trusted-ca-bundle\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.092112 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091784    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-tls-assets\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.092112 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091789    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:29:14.092112 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.091815    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-kubelet-serving-ca-bundle\") pod \"52241f06-1492-4bd0-be9a-0ea8fb83b243\" (UID: \"52241f06-1492-4bd0-be9a-0ea8fb83b243\") "
May 28 18:29:14.092112 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.092107    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-metrics-client-ca\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.092494 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.092439    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:29:14.092597 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.092555    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:29:14.092864 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.092840    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:29:14.093774 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.093717    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:29:14.094442 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.094334    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:29:14.094442 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.094414    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:29:14.094852 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.094703    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-kube-api-access-8kkzr" (OuterVolumeSpecName: "kube-api-access-8kkzr") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "kube-api-access-8kkzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:29:14.094852 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.094703    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:29:14.094852 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.094797    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:29:14.094852 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.094817    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-config-out" (OuterVolumeSpecName: "config-out") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:29:14.095831 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.095800    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:29:14.096242 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.096209    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-config" (OuterVolumeSpecName: "config") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:29:14.096351 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.096221    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:29:14.096716 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.096686    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:29:14.096825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.096776    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:29:14.096935 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.096916    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:29:14.106885 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.106852    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-web-config" (OuterVolumeSpecName: "web-config") pod "52241f06-1492-4bd0-be9a-0ea8fb83b243" (UID: "52241f06-1492-4bd0-be9a-0ea8fb83b243"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:29:14.193358 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193304    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-kube-rbac-proxy\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193358 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193354    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-metrics-client-certs\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193358 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193364    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kkzr\" (UniqueName: \"kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-kube-api-access-8kkzr\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193358 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193373    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193383    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-web-config\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193393    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193404    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193414    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-k8s-db\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193424    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-config\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193432    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52241f06-1492-4bd0-be9a-0ea8fb83b243-config-out\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193441    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193450    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193460    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-grpc-tls\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193468    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52241f06-1492-4bd0-be9a-0ea8fb83b243-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193477    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193485    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52241f06-1492-4bd0-be9a-0ea8fb83b243-tls-assets\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.193631 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.193495    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52241f06-1492-4bd0-be9a-0ea8fb83b243-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:29:14.700412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700364    2562 generic.go:358] "Generic (PLEG): container finished" podID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerID="b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769" exitCode=0
May 28 18:29:14.700412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700397    2562 generic.go:358] "Generic (PLEG): container finished" podID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerID="514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf" exitCode=0
May 28 18:29:14.700412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700406    2562 generic.go:358] "Generic (PLEG): container finished" podID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerID="0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048" exitCode=0
May 28 18:29:14.700412 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700414    2562 generic.go:358] "Generic (PLEG): container finished" podID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerID="3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44" exitCode=0
May 28 18:29:14.701062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700423    2562 generic.go:358] "Generic (PLEG): container finished" podID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerID="11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39" exitCode=0
May 28 18:29:14.701062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700431    2562 generic.go:358] "Generic (PLEG): container finished" podID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerID="8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc" exitCode=0
May 28 18:29:14.701062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700436    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerDied","Data":"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"}
May 28 18:29:14.701062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700481    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.701062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700493    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerDied","Data":"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"}
May 28 18:29:14.701062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700513    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerDied","Data":"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"}
May 28 18:29:14.701062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700527    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerDied","Data":"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"}
May 28 18:29:14.701062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700542    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerDied","Data":"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"}
May 28 18:29:14.701062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700557    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerDied","Data":"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"}
May 28 18:29:14.701062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700563    2562 scope.go:117] "RemoveContainer" containerID="b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"
May 28 18:29:14.701062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.700572    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52241f06-1492-4bd0-be9a-0ea8fb83b243","Type":"ContainerDied","Data":"8e66cfba0e742d11b12c7ba12fb6cbc615c6ba5f95a705b23d18f40cb7b7dfba"}
May 28 18:29:14.709639 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.709530    2562 scope.go:117] "RemoveContainer" containerID="514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"
May 28 18:29:14.716760 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.716739    2562 scope.go:117] "RemoveContainer" containerID="0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"
May 28 18:29:14.723517 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.723486    2562 scope.go:117] "RemoveContainer" containerID="3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"
May 28 18:29:14.726460 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.726431    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 18:29:14.729466 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.729347    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 18:29:14.742189 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.742171    2562 scope.go:117] "RemoveContainer" containerID="11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"
May 28 18:29:14.749316 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.749296    2562 scope.go:117] "RemoveContainer" containerID="8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"
May 28 18:29:14.753929 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.753902    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 18:29:14.754235 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754215    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="init-config-reloader"
May 28 18:29:14.754235 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754234    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="init-config-reloader"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754243    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="config-reloader"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754249    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="config-reloader"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754264    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754270    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754283    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="prometheus"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754289    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="prometheus"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754296    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy-web"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754301    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy-web"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754307    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy-thanos"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754312    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy-thanos"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754319    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="thanos-sidecar"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754324    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="thanos-sidecar"
May 28 18:29:14.754368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754367    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy"
May 28 18:29:14.754891 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754376    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="thanos-sidecar"
May 28 18:29:14.754891 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754383    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy-thanos"
May 28 18:29:14.754891 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754390    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="config-reloader"
May 28 18:29:14.754891 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754398    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="prometheus"
May 28 18:29:14.754891 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.754404    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" containerName="kube-rbac-proxy-web"
May 28 18:29:14.757296 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.757277    2562 scope.go:117] "RemoveContainer" containerID="61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"
May 28 18:29:14.759698 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.759679    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.762370 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.762344    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8vqvj\""
May 28 18:29:14.762468 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.762420    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 18:29:14.762468 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.762442    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 18:29:14.762628 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.762609    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fuir185jlv0gj\""
May 28 18:29:14.762839 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.762671    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 18:29:14.762839 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.762689    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 18:29:14.762839 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.762771    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 18:29:14.762839 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.762812    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 18:29:14.763038 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.763022    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 18:29:14.763243 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.763227    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 18:29:14.763307 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.763279    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 18:29:14.763439 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.763423    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 18:29:14.765825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.765810    2562 scope.go:117] "RemoveContainer" containerID="b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"
May 28 18:29:14.766082 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.766054    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 18:29:14.766229 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:29:14.766200    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": container with ID starting with b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769 not found: ID does not exist" containerID="b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"
May 28 18:29:14.766294 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.766230    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"} err="failed to get container status \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": rpc error: code = NotFound desc = could not find container \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": container with ID starting with b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769 not found: ID does not exist"
May 28 18:29:14.766294 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.766260    2562 scope.go:117] "RemoveContainer" containerID="514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"
May 28 18:29:14.766521 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:29:14.766502    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": container with ID starting with 514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf not found: ID does not exist" containerID="514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"
May 28 18:29:14.766587 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.766532    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"} err="failed to get container status \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": rpc error: code = NotFound desc = could not find container \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": container with ID starting with 514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf not found: ID does not exist"
May 28 18:29:14.766587 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.766555    2562 scope.go:117] "RemoveContainer" containerID="0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"
May 28 18:29:14.766844 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:29:14.766826    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": container with ID starting with 0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048 not found: ID does not exist" containerID="0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"
May 28 18:29:14.766907 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.766850    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"} err="failed to get container status \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": rpc error: code = NotFound desc = could not find container \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": container with ID starting with 0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048 not found: ID does not exist"
May 28 18:29:14.766907 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.766868    2562 scope.go:117] "RemoveContainer" containerID="3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"
May 28 18:29:14.767155 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:29:14.767130    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": container with ID starting with 3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44 not found: ID does not exist" containerID="3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"
May 28 18:29:14.767218 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.767164    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"} err="failed to get container status \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": rpc error: code = NotFound desc = could not find container \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": container with ID starting with 3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44 not found: ID does not exist"
May 28 18:29:14.767218 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.767190    2562 scope.go:117] "RemoveContainer" containerID="11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"
May 28 18:29:14.767448 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:29:14.767428    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": container with ID starting with 11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39 not found: ID does not exist" containerID="11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"
May 28 18:29:14.767642 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.767453    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"} err="failed to get container status \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": rpc error: code = NotFound desc = could not find container \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": container with ID starting with 11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39 not found: ID does not exist"
May 28 18:29:14.767642 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.767474    2562 scope.go:117] "RemoveContainer" containerID="8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"
May 28 18:29:14.773657 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.771529    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 18:29:14.773657 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:29:14.772436    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": container with ID starting with 8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc not found: ID does not exist" containerID="8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"
May 28 18:29:14.773657 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.772469    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"} err="failed to get container status \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": rpc error: code = NotFound desc = could not find container \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": container with ID starting with 8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc not found: ID does not exist"
May 28 18:29:14.773657 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.772492    2562 scope.go:117] "RemoveContainer" containerID="61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"
May 28 18:29:14.773657 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:29:14.772823    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": container with ID starting with 61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717 not found: ID does not exist" containerID="61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"
May 28 18:29:14.773657 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.772851    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"} err="failed to get container status \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": rpc error: code = NotFound desc = could not find container \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": container with ID starting with 61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717 not found: ID does not exist"
May 28 18:29:14.773657 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.772872    2562 scope.go:117] "RemoveContainer" containerID="b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"
May 28 18:29:14.773657 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.773139    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"} err="failed to get container status \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": rpc error: code = NotFound desc = could not find container \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": container with ID starting with b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769 not found: ID does not exist"
May 28 18:29:14.773657 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.773163    2562 scope.go:117] "RemoveContainer" containerID="514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"
May 28 18:29:14.773657 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.773403    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"} err="failed to get container status \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": rpc error: code = NotFound desc = could not find container \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": container with ID starting with 514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf not found: ID does not exist"
May 28 18:29:14.773657 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.773433    2562 scope.go:117] "RemoveContainer" containerID="0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"
May 28 18:29:14.774305 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.773746    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"} err="failed to get container status \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": rpc error: code = NotFound desc = could not find container \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": container with ID starting with 0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048 not found: ID does not exist"
May 28 18:29:14.774305 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.773771    2562 scope.go:117] "RemoveContainer" containerID="3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"
May 28 18:29:14.774305 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.774009    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"} err="failed to get container status \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": rpc error: code = NotFound desc = could not find container \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": container with ID starting with 3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44 not found: ID does not exist"
May 28 18:29:14.774305 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.774039    2562 scope.go:117] "RemoveContainer" containerID="11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"
May 28 18:29:14.774530 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.774499    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"} err="failed to get container status \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": rpc error: code = NotFound desc = could not find container \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": container with ID starting with 11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39 not found: ID does not exist"
May 28 18:29:14.774530 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.774532    2562 scope.go:117] "RemoveContainer" containerID="8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"
May 28 18:29:14.775204 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.775033    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"} err="failed to get container status \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": rpc error: code = NotFound desc = could not find container \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": container with ID starting with 8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc not found: ID does not exist"
May 28 18:29:14.775204 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.775064    2562 scope.go:117] "RemoveContainer" containerID="61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"
May 28 18:29:14.775377 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.775292    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"} err="failed to get container status \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": rpc error: code = NotFound desc = could not find container \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": container with ID starting with 61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717 not found: ID does not exist"
May 28 18:29:14.775377 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.775314    2562 scope.go:117] "RemoveContainer" containerID="b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"
May 28 18:29:14.775574 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.775553    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"} err="failed to get container status \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": rpc error: code = NotFound desc = could not find container \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": container with ID starting with b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769 not found: ID does not exist"
May 28 18:29:14.775645 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.775575    2562 scope.go:117] "RemoveContainer" containerID="514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"
May 28 18:29:14.775858 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.775833    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"} err="failed to get container status \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": rpc error: code = NotFound desc = could not find container \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": container with ID starting with 514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf not found: ID does not exist"
May 28 18:29:14.775858 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.775858    2562 scope.go:117] "RemoveContainer" containerID="0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"
May 28 18:29:14.776094 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.776068    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"} err="failed to get container status \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": rpc error: code = NotFound desc = could not find container \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": container with ID starting with 0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048 not found: ID does not exist"
May 28 18:29:14.776186 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.776095    2562 scope.go:117] "RemoveContainer" containerID="3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"
May 28 18:29:14.776320 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.776300    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"} err="failed to get container status \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": rpc error: code = NotFound desc = could not find container \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": container with ID starting with 3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44 not found: ID does not exist"
May 28 18:29:14.776426 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.776320    2562 scope.go:117] "RemoveContainer" containerID="11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"
May 28 18:29:14.776486 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.776434    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 18:29:14.776535 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.776502    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"} err="failed to get container status \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": rpc error: code = NotFound desc = could not find container \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": container with ID starting with 11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39 not found: ID does not exist"
May 28 18:29:14.776535 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.776518    2562 scope.go:117] "RemoveContainer" containerID="8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"
May 28 18:29:14.776788 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.776767    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"} err="failed to get container status \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": rpc error: code = NotFound desc = could not find container \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": container with ID starting with 8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc not found: ID does not exist"
May 28 18:29:14.776870 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.776790    2562 scope.go:117] "RemoveContainer" containerID="61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"
May 28 18:29:14.777058 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.777038    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"} err="failed to get container status \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": rpc error: code = NotFound desc = could not find container \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": container with ID starting with 61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717 not found: ID does not exist"
May 28 18:29:14.777132 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.777057    2562 scope.go:117] "RemoveContainer" containerID="b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"
May 28 18:29:14.777271 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.777256    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"} err="failed to get container status \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": rpc error: code = NotFound desc = could not find container \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": container with ID starting with b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769 not found: ID does not exist"
May 28 18:29:14.777364 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.777271    2562 scope.go:117] "RemoveContainer" containerID="514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"
May 28 18:29:14.777500 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.777477    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"} err="failed to get container status \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": rpc error: code = NotFound desc = could not find container \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": container with ID starting with 514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf not found: ID does not exist"
May 28 18:29:14.777558 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.777503    2562 scope.go:117] "RemoveContainer" containerID="0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"
May 28 18:29:14.777713 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.777695    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"} err="failed to get container status \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": rpc error: code = NotFound desc = could not find container \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": container with ID starting with 0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048 not found: ID does not exist"
May 28 18:29:14.777807 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.777713    2562 scope.go:117] "RemoveContainer" containerID="3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"
May 28 18:29:14.777923 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.777905    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"} err="failed to get container status \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": rpc error: code = NotFound desc = could not find container \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": container with ID starting with 3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44 not found: ID does not exist"
May 28 18:29:14.777923 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.777922    2562 scope.go:117] "RemoveContainer" containerID="11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"
May 28 18:29:14.778128 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.778108    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"} err="failed to get container status \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": rpc error: code = NotFound desc = could not find container \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": container with ID starting with 11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39 not found: ID does not exist"
May 28 18:29:14.778198 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.778129    2562 scope.go:117] "RemoveContainer" containerID="8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"
May 28 18:29:14.778312 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.778293    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"} err="failed to get container status \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": rpc error: code = NotFound desc = could not find container \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": container with ID starting with 8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc not found: ID does not exist"
May 28 18:29:14.778377 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.778313    2562 scope.go:117] "RemoveContainer" containerID="61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"
May 28 18:29:14.778533 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.778513    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"} err="failed to get container status \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": rpc error: code = NotFound desc = could not find container \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": container with ID starting with 61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717 not found: ID does not exist"
May 28 18:29:14.778533 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.778532    2562 scope.go:117] "RemoveContainer" containerID="b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"
May 28 18:29:14.778734 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.778700    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"} err="failed to get container status \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": rpc error: code = NotFound desc = could not find container \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": container with ID starting with b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769 not found: ID does not exist"
May 28 18:29:14.778734 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.778734    2562 scope.go:117] "RemoveContainer" containerID="514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"
May 28 18:29:14.778989 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.778965    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"} err="failed to get container status \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": rpc error: code = NotFound desc = could not find container \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": container with ID starting with 514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf not found: ID does not exist"
May 28 18:29:14.779053 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.778991    2562 scope.go:117] "RemoveContainer" containerID="0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"
May 28 18:29:14.779240 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.779217    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"} err="failed to get container status \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": rpc error: code = NotFound desc = could not find container \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": container with ID starting with 0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048 not found: ID does not exist"
May 28 18:29:14.779299 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.779243    2562 scope.go:117] "RemoveContainer" containerID="3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"
May 28 18:29:14.779531 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.779505    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"} err="failed to get container status \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": rpc error: code = NotFound desc = could not find container \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": container with ID starting with 3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44 not found: ID does not exist"
May 28 18:29:14.779629 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.779533    2562 scope.go:117] "RemoveContainer" containerID="11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"
May 28 18:29:14.779800 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.779780    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"} err="failed to get container status \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": rpc error: code = NotFound desc = could not find container \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": container with ID starting with 11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39 not found: ID does not exist"
May 28 18:29:14.779800 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.779799    2562 scope.go:117] "RemoveContainer" containerID="8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"
May 28 18:29:14.780029 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.780009    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"} err="failed to get container status \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": rpc error: code = NotFound desc = could not find container \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": container with ID starting with 8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc not found: ID does not exist"
May 28 18:29:14.780116 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.780029    2562 scope.go:117] "RemoveContainer" containerID="61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"
May 28 18:29:14.780240 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.780223    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"} err="failed to get container status \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": rpc error: code = NotFound desc = could not find container \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": container with ID starting with 61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717 not found: ID does not exist"
May 28 18:29:14.780300 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.780240    2562 scope.go:117] "RemoveContainer" containerID="b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"
May 28 18:29:14.780502 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.780485    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769"} err="failed to get container status \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": rpc error: code = NotFound desc = could not find container \"b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769\": container with ID starting with b5744ad648286a45ac9c368f2b79b053ab95040ba70a2daf11ca92b035e60769 not found: ID does not exist"
May 28 18:29:14.780502 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.780501    2562 scope.go:117] "RemoveContainer" containerID="514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"
May 28 18:29:14.780711 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.780695    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf"} err="failed to get container status \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": rpc error: code = NotFound desc = could not find container \"514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf\": container with ID starting with 514a4555065bd6f2d5b4bab3ab7e7954c44afc9b0e7a4f9ed31ccdfb8c4740cf not found: ID does not exist"
May 28 18:29:14.780711 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.780710    2562 scope.go:117] "RemoveContainer" containerID="0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"
May 28 18:29:14.780973 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.780954    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048"} err="failed to get container status \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": rpc error: code = NotFound desc = could not find container \"0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048\": container with ID starting with 0515a3cef4e2db274241bbbbcc7738dccc1eaba226c14a37ab90ae9956157048 not found: ID does not exist"
May 28 18:29:14.780973 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.780972    2562 scope.go:117] "RemoveContainer" containerID="3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"
May 28 18:29:14.781168 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.781149    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44"} err="failed to get container status \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": rpc error: code = NotFound desc = could not find container \"3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44\": container with ID starting with 3ea6b702809c40c10bbfedeaadcb202b55c358d82c457ada7ef36d2f71691e44 not found: ID does not exist"
May 28 18:29:14.781236 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.781169    2562 scope.go:117] "RemoveContainer" containerID="11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"
May 28 18:29:14.781334 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.781318    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39"} err="failed to get container status \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": rpc error: code = NotFound desc = could not find container \"11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39\": container with ID starting with 11a28e12d6cc680bdecd7edaa41af26ecf52c3dbb989a450974647751af75f39 not found: ID does not exist"
May 28 18:29:14.781390 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.781334    2562 scope.go:117] "RemoveContainer" containerID="8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"
May 28 18:29:14.781552 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.781527    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc"} err="failed to get container status \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": rpc error: code = NotFound desc = could not find container \"8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc\": container with ID starting with 8204369f4751f6f086851d8a5dce70bbc07b788ea261c19d5d65bc9029c806dc not found: ID does not exist"
May 28 18:29:14.781625 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.781552    2562 scope.go:117] "RemoveContainer" containerID="61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"
May 28 18:29:14.781766 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.781749    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717"} err="failed to get container status \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": rpc error: code = NotFound desc = could not find container \"61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717\": container with ID starting with 61815bdc009e25a5a4eb35e1413cd4b0123ef4c6cc7354dfe29659f51a09d717 not found: ID does not exist"
May 28 18:29:14.899522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899757 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899757 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvvcj\" (UniqueName: \"kubernetes.io/projected/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-kube-api-access-hvvcj\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899757 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899757 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899687    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899908 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899908 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899908 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-config\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899908 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899908 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899908 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899908 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899908 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.899908 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899905    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.900198 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.900198 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:14.900198 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:14.899987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001199 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001106    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-config\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001199 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001143    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001199 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001161    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001199 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001179    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001199 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001198    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001215    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001231    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001264    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001294    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001322    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001376    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001402    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001436    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001478    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvvcj\" (UniqueName: \"kubernetes.io/projected/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-kube-api-access-hvvcj\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.001522 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001510    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.002097 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001539    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.002097 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001574    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.002097 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001599    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.002097 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.001702    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.002097 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.002066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.004235 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.003936    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.005382 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.004863    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-config\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.005382 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.005029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.005382 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.005113    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.005382 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.005316    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.005382 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.005321    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.005711 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.005440    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.005711 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.005569    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.006208 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.006177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.006321 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.006228    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.006540 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.006520    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.006653 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.006632    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.007008 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.006987    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.007615 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.007597    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.007710 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.007654    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.009943 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.009923    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvvcj\" (UniqueName: \"kubernetes.io/projected/b81204b5-a4dd-45ae-8f9e-4682c992cf0c-kube-api-access-hvvcj\") pod \"prometheus-k8s-0\" (UID: \"b81204b5-a4dd-45ae-8f9e-4682c992cf0c\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.075840 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.075788    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:29:15.212766 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.212736    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 18:29:15.215203 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:29:15.215177    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81204b5_a4dd_45ae_8f9e_4682c992cf0c.slice/crio-f19fd3f2ea8d23053a537eb9697c4724bf438f9f9b187a562b0fd63726b2d060 WatchSource:0}: Error finding container f19fd3f2ea8d23053a537eb9697c4724bf438f9f9b187a562b0fd63726b2d060: Status 404 returned error can't find the container with id f19fd3f2ea8d23053a537eb9697c4724bf438f9f9b187a562b0fd63726b2d060
May 28 18:29:15.704703 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.704664    2562 generic.go:358] "Generic (PLEG): container finished" podID="b81204b5-a4dd-45ae-8f9e-4682c992cf0c" containerID="262885fcfa0233957c35a4b9b7835905b8eead1fd44f46d278332768e645bec6" exitCode=0
May 28 18:29:15.705117 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.704746    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b81204b5-a4dd-45ae-8f9e-4682c992cf0c","Type":"ContainerDied","Data":"262885fcfa0233957c35a4b9b7835905b8eead1fd44f46d278332768e645bec6"}
May 28 18:29:15.705117 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:15.704784    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b81204b5-a4dd-45ae-8f9e-4682c992cf0c","Type":"ContainerStarted","Data":"f19fd3f2ea8d23053a537eb9697c4724bf438f9f9b187a562b0fd63726b2d060"}
May 28 18:29:16.012185 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:16.012153    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52241f06-1492-4bd0-be9a-0ea8fb83b243" path="/var/lib/kubelet/pods/52241f06-1492-4bd0-be9a-0ea8fb83b243/volumes"
May 28 18:29:16.711994 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:16.711958    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b81204b5-a4dd-45ae-8f9e-4682c992cf0c","Type":"ContainerStarted","Data":"f20ca7aa897e37aa47dd40c7fc218f166c1d7649178b9a980c2ff0f6c6e35322"}
May 28 18:29:16.712416 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:16.712003    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b81204b5-a4dd-45ae-8f9e-4682c992cf0c","Type":"ContainerStarted","Data":"5c824552adb36682bd6e56a5127fea9d519b882ca63c08b23c6b09b7b166e77c"}
May 28 18:29:16.712416 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:16.712020    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b81204b5-a4dd-45ae-8f9e-4682c992cf0c","Type":"ContainerStarted","Data":"a0c378f35355cf8c2bd0f664a59884ba0fd24770135e3b50940e3d9c6f03725f"}
May 28 18:29:16.712416 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:16.712034    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b81204b5-a4dd-45ae-8f9e-4682c992cf0c","Type":"ContainerStarted","Data":"e3142664e387eda9bed85b61985232e1c40cea528e8db254e1f796f85bfee200"}
May 28 18:29:16.712416 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:16.712045    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b81204b5-a4dd-45ae-8f9e-4682c992cf0c","Type":"ContainerStarted","Data":"18eee7fb921404429eed9b1d653f223bba6a70864f413f79429ffdfc2af176ef"}
May 28 18:29:16.712416 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:16.712057    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b81204b5-a4dd-45ae-8f9e-4682c992cf0c","Type":"ContainerStarted","Data":"a215b5c1aff02cdbbd69b966f6a9f71ee6c4410fc338e7ecc3e3087cdd253acd"}
May 28 18:29:16.737837 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:16.737774    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.737755469 podStartE2EDuration="2.737755469s" podCreationTimestamp="2026-05-28 18:29:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:29:16.736098581 +0000 UTC m=+187.325708222" watchObservedRunningTime="2026-05-28 18:29:16.737755469 +0000 UTC m=+187.327365111"
May 28 18:29:20.076361 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:29:20.076310    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:30:15.076798 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:30:15.076756    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:30:15.092478 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:30:15.092450    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:30:15.903345 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:30:15.903316    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 18:31:09.919604 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:31:09.919568    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:31:09.920125 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:31:09.920054    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:31:09.923426 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:31:09.923402    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:31:09.923822 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:31:09.923804    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:31:09.929502 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:31:09.929481    2562 kubelet.go:1628] "Image garbage collection succeeded"
May 28 18:32:37.540045 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.540009    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6wp9f"]
May 28 18:32:37.543327 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.543307    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-6wp9f"
May 28 18:32:37.545143 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.545121    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 18:32:37.545143 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.545133    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lk4bk\""
May 28 18:32:37.546002 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.545985    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 18:32:37.552360 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.552337    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6wp9f"]
May 28 18:32:37.609802 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.609765    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3042268b-5880-452e-8552-56ed7b6dde30-bound-sa-token\") pod \"cert-manager-79c8d999ff-6wp9f\" (UID: \"3042268b-5880-452e-8552-56ed7b6dde30\") " pod="cert-manager/cert-manager-79c8d999ff-6wp9f"
May 28 18:32:37.609972 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.609835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24tfz\" (UniqueName: \"kubernetes.io/projected/3042268b-5880-452e-8552-56ed7b6dde30-kube-api-access-24tfz\") pod \"cert-manager-79c8d999ff-6wp9f\" (UID: \"3042268b-5880-452e-8552-56ed7b6dde30\") " pod="cert-manager/cert-manager-79c8d999ff-6wp9f"
May 28 18:32:37.711056 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.711020    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24tfz\" (UniqueName: \"kubernetes.io/projected/3042268b-5880-452e-8552-56ed7b6dde30-kube-api-access-24tfz\") pod \"cert-manager-79c8d999ff-6wp9f\" (UID: \"3042268b-5880-452e-8552-56ed7b6dde30\") " pod="cert-manager/cert-manager-79c8d999ff-6wp9f"
May 28 18:32:37.711226 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.711105    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3042268b-5880-452e-8552-56ed7b6dde30-bound-sa-token\") pod \"cert-manager-79c8d999ff-6wp9f\" (UID: \"3042268b-5880-452e-8552-56ed7b6dde30\") " pod="cert-manager/cert-manager-79c8d999ff-6wp9f"
May 28 18:32:37.718571 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.718536    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3042268b-5880-452e-8552-56ed7b6dde30-bound-sa-token\") pod \"cert-manager-79c8d999ff-6wp9f\" (UID: \"3042268b-5880-452e-8552-56ed7b6dde30\") " pod="cert-manager/cert-manager-79c8d999ff-6wp9f"
May 28 18:32:37.718691 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.718676    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24tfz\" (UniqueName: \"kubernetes.io/projected/3042268b-5880-452e-8552-56ed7b6dde30-kube-api-access-24tfz\") pod \"cert-manager-79c8d999ff-6wp9f\" (UID: \"3042268b-5880-452e-8552-56ed7b6dde30\") " pod="cert-manager/cert-manager-79c8d999ff-6wp9f"
May 28 18:32:37.873223 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.873128    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-6wp9f"
May 28 18:32:37.996698 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:37.996665    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-6wp9f"]
May 28 18:32:38.000147 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:32:38.000104    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3042268b_5880_452e_8552_56ed7b6dde30.slice/crio-6d51f5b98cc62d0adb0dfe27422aac3c8af32789535a9423085f4bec35baf404 WatchSource:0}: Error finding container 6d51f5b98cc62d0adb0dfe27422aac3c8af32789535a9423085f4bec35baf404: Status 404 returned error can't find the container with id 6d51f5b98cc62d0adb0dfe27422aac3c8af32789535a9423085f4bec35baf404
May 28 18:32:38.001907 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:38.001892    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:32:38.312290 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:38.312253    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-6wp9f" event={"ID":"3042268b-5880-452e-8552-56ed7b6dde30","Type":"ContainerStarted","Data":"6d51f5b98cc62d0adb0dfe27422aac3c8af32789535a9423085f4bec35baf404"}
May 28 18:32:42.327661 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:42.327620    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-6wp9f" event={"ID":"3042268b-5880-452e-8552-56ed7b6dde30","Type":"ContainerStarted","Data":"db444df51c8d5ef2452b6bac664e48fee2f48878afed747e2edecaeb4859864c"}
May 28 18:32:42.341275 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:42.341205    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-6wp9f" podStartSLOduration=1.947044151 podStartE2EDuration="5.341191617s" podCreationTimestamp="2026-05-28 18:32:37 +0000 UTC" firstStartedPulling="2026-05-28 18:32:38.002014124 +0000 UTC m=+388.591623742" lastFinishedPulling="2026-05-28 18:32:41.39616159 +0000 UTC m=+391.985771208" observedRunningTime="2026-05-28 18:32:42.340001321 +0000 UTC m=+392.929610962" watchObservedRunningTime="2026-05-28 18:32:42.341191617 +0000 UTC m=+392.930801258"
May 28 18:32:44.837015 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.836969    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"]
May 28 18:32:44.840659 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.840632    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:44.842874 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.842843    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 28 18:32:44.842874 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.842868    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 18:32:44.843048 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.843032    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 18:32:44.843465 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.843446    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 28 18:32:44.843531 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.843475    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dssbk\""
May 28 18:32:44.843531 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.843501    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 28 18:32:44.848063 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.848038    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"]
May 28 18:32:44.973922 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.973881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cknq6\" (UniqueName: \"kubernetes.io/projected/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-kube-api-access-cknq6\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:44.973922 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.973928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-cert\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:44.974138 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.973957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-metrics-cert\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:44.974138 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:44.974034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-manager-config\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:45.075417 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:45.075367    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-manager-config\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:45.075599 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:45.075468    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cknq6\" (UniqueName: \"kubernetes.io/projected/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-kube-api-access-cknq6\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:45.075599 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:45.075502    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-cert\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:45.075599 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:45.075517    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-metrics-cert\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:45.076073 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:45.076047    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-manager-config\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:45.078168 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:45.078147    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-cert\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:45.078274 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:45.078215    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-metrics-cert\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:45.090866 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:45.090794    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cknq6\" (UniqueName: \"kubernetes.io/projected/19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2-kube-api-access-cknq6\") pod \"lws-controller-manager-85db54859f-vjmd2\" (UID: \"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2\") " pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:45.150566 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:45.150519    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:45.285892 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:45.285823    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"]
May 28 18:32:45.288366 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:32:45.288343    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19908dd7_2bf9_4d2b_9e0d_eddf0b07e9d2.slice/crio-85cf012f917dcaa72128319f7f7a2c36ef20d43c70f2017a6931c4cb5db5bff1 WatchSource:0}: Error finding container 85cf012f917dcaa72128319f7f7a2c36ef20d43c70f2017a6931c4cb5db5bff1: Status 404 returned error can't find the container with id 85cf012f917dcaa72128319f7f7a2c36ef20d43c70f2017a6931c4cb5db5bff1
May 28 18:32:45.337570 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:45.337534    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2" event={"ID":"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2","Type":"ContainerStarted","Data":"85cf012f917dcaa72128319f7f7a2c36ef20d43c70f2017a6931c4cb5db5bff1"}
May 28 18:32:50.354849 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:50.354798    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2" event={"ID":"19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2","Type":"ContainerStarted","Data":"b614dd3a9b40c5736effc5edbe6b1b74c470e54cc7f8e3d59e219474924c0679"}
May 28 18:32:50.355273 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:50.354968    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:32:50.376939 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:50.376885    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2" podStartSLOduration=2.202231578 podStartE2EDuration="6.376871056s" podCreationTimestamp="2026-05-28 18:32:44 +0000 UTC" firstStartedPulling="2026-05-28 18:32:45.290569362 +0000 UTC m=+395.880178984" lastFinishedPulling="2026-05-28 18:32:49.465208827 +0000 UTC m=+400.054818462" observedRunningTime="2026-05-28 18:32:50.374904633 +0000 UTC m=+400.964514286" watchObservedRunningTime="2026-05-28 18:32:50.376871056 +0000 UTC m=+400.966480696"
May 28 18:32:54.020409 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.020372    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"]
May 28 18:32:54.023782 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.023758    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:54.025989 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.025963    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 18:32:54.025989 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.025982    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 18:32:54.026246 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.026226    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 18:32:54.026338 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.026269    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6948x\""
May 28 18:32:54.026338 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.026271    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 18:32:54.039393 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.039369    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"]
May 28 18:32:54.161091 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.155522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcbst\" (UniqueName: \"kubernetes.io/projected/82a367ab-e879-46d4-b6bd-fd861a8d3490-kube-api-access-lcbst\") pod \"opendatahub-operator-controller-manager-b658c4654-b2v6f\" (UID: \"82a367ab-e879-46d4-b6bd-fd861a8d3490\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:54.161091 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.156116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82a367ab-e879-46d4-b6bd-fd861a8d3490-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-b2v6f\" (UID: \"82a367ab-e879-46d4-b6bd-fd861a8d3490\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:54.161091 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.156178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82a367ab-e879-46d4-b6bd-fd861a8d3490-webhook-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-b2v6f\" (UID: \"82a367ab-e879-46d4-b6bd-fd861a8d3490\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:54.257031 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.256980    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbst\" (UniqueName: \"kubernetes.io/projected/82a367ab-e879-46d4-b6bd-fd861a8d3490-kube-api-access-lcbst\") pod \"opendatahub-operator-controller-manager-b658c4654-b2v6f\" (UID: \"82a367ab-e879-46d4-b6bd-fd861a8d3490\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:54.257228 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.257083    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82a367ab-e879-46d4-b6bd-fd861a8d3490-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-b2v6f\" (UID: \"82a367ab-e879-46d4-b6bd-fd861a8d3490\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:54.257228 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.257109    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82a367ab-e879-46d4-b6bd-fd861a8d3490-webhook-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-b2v6f\" (UID: \"82a367ab-e879-46d4-b6bd-fd861a8d3490\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:54.259566 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.259537    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82a367ab-e879-46d4-b6bd-fd861a8d3490-webhook-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-b2v6f\" (UID: \"82a367ab-e879-46d4-b6bd-fd861a8d3490\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:54.259677 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.259575    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/82a367ab-e879-46d4-b6bd-fd861a8d3490-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-b2v6f\" (UID: \"82a367ab-e879-46d4-b6bd-fd861a8d3490\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:54.264158 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.264132    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcbst\" (UniqueName: \"kubernetes.io/projected/82a367ab-e879-46d4-b6bd-fd861a8d3490-kube-api-access-lcbst\") pod \"opendatahub-operator-controller-manager-b658c4654-b2v6f\" (UID: \"82a367ab-e879-46d4-b6bd-fd861a8d3490\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:54.333426 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.333337    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:54.472023 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:54.471997    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"]
May 28 18:32:54.474928 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:32:54.474902    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a367ab_e879_46d4_b6bd_fd861a8d3490.slice/crio-60aee6c1f88e3f879d8badbcf5414c1cdf5622ccc05f145db5616fc7ec8415b6 WatchSource:0}: Error finding container 60aee6c1f88e3f879d8badbcf5414c1cdf5622ccc05f145db5616fc7ec8415b6: Status 404 returned error can't find the container with id 60aee6c1f88e3f879d8badbcf5414c1cdf5622ccc05f145db5616fc7ec8415b6
May 28 18:32:55.371453 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:55.371409    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f" event={"ID":"82a367ab-e879-46d4-b6bd-fd861a8d3490","Type":"ContainerStarted","Data":"60aee6c1f88e3f879d8badbcf5414c1cdf5622ccc05f145db5616fc7ec8415b6"}
May 28 18:32:57.379598 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:57.379505    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f" event={"ID":"82a367ab-e879-46d4-b6bd-fd861a8d3490","Type":"ContainerStarted","Data":"7030223e3d4b831eebeca2d3ea00181736216dba42a11937d555512f74934d28"}
May 28 18:32:57.379986 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:57.379622    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:32:57.401407 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:32:57.401115    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f" podStartSLOduration=1.838895132 podStartE2EDuration="4.401097202s" podCreationTimestamp="2026-05-28 18:32:53 +0000 UTC" firstStartedPulling="2026-05-28 18:32:54.476579971 +0000 UTC m=+405.066189595" lastFinishedPulling="2026-05-28 18:32:57.038782029 +0000 UTC m=+407.628391665" observedRunningTime="2026-05-28 18:32:57.400538947 +0000 UTC m=+407.990148591" watchObservedRunningTime="2026-05-28 18:32:57.401097202 +0000 UTC m=+407.990706844"
May 28 18:33:01.360027 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:33:01.359995    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85db54859f-vjmd2"
May 28 18:33:08.385605 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:33:08.385573    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-b2v6f"
May 28 18:34:17.741707 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.741674    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"]
May 28 18:34:17.744266 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.744243    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.746413 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.746389    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 28 18:34:17.746413 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.746403    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bgvrl\""
May 28 18:34:17.754983 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.754955    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"]
May 28 18:34:17.866465 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.866428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.866644 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.866469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.866644 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.866551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.866644 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.866600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.866644 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.866634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.866889 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.866678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.866889 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.866770    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsrtj\" (UniqueName: \"kubernetes.io/projected/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-kube-api-access-qsrtj\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.866889 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.866806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.867011 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.866883    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.968333 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.968298    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.968506 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.968357    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.968506 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.968403    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.968506 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.968430    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.968506 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.968469    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.968506 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.968504    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.968780 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.968540    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.968780 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.968591    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.968780 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.968631    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsrtj\" (UniqueName: \"kubernetes.io/projected/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-kube-api-access-qsrtj\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.968932 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.968836    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.968932 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.968904    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.969110 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.969089    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.969166 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.969118    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.969166 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.969117    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.970801 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.970775    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.971116 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.971098    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.978001 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.977979    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsrtj\" (UniqueName: \"kubernetes.io/projected/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-kube-api-access-qsrtj\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:17.978131 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:17.978111    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ccccddd-e3ce-4160-8ea5-5641f19fcb52-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd\" (UID: \"2ccccddd-e3ce-4160-8ea5-5641f19fcb52\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:18.055396 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:18.055290    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:18.182378 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:18.182289    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"]
May 28 18:34:18.185123 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:34:18.185094    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ccccddd_e3ce_4160_8ea5_5641f19fcb52.slice/crio-9257c674fe5afa159e1dcbf517ec7304fa0593c8fcf8c9e9f5ec4ac792894255 WatchSource:0}: Error finding container 9257c674fe5afa159e1dcbf517ec7304fa0593c8fcf8c9e9f5ec4ac792894255: Status 404 returned error can't find the container with id 9257c674fe5afa159e1dcbf517ec7304fa0593c8fcf8c9e9f5ec4ac792894255
May 28 18:34:18.634944 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:18.634908    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd" event={"ID":"2ccccddd-e3ce-4160-8ea5-5641f19fcb52","Type":"ContainerStarted","Data":"9257c674fe5afa159e1dcbf517ec7304fa0593c8fcf8c9e9f5ec4ac792894255"}
May 28 18:34:21.493421 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:21.493379    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:34:21.493668 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:21.493473    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:34:21.493668 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:21.493506    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:34:21.648915 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:21.648878    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd" event={"ID":"2ccccddd-e3ce-4160-8ea5-5641f19fcb52","Type":"ContainerStarted","Data":"0ca5d3270c86d3d45d98d8b3cab0bcd259eca722025f059190ca6c1d7ea280b9"}
May 28 18:34:21.668786 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:21.668738    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd" podStartSLOduration=1.362632864 podStartE2EDuration="4.668708195s" podCreationTimestamp="2026-05-28 18:34:17 +0000 UTC" firstStartedPulling="2026-05-28 18:34:18.186992146 +0000 UTC m=+488.776601766" lastFinishedPulling="2026-05-28 18:34:21.493067473 +0000 UTC m=+492.082677097" observedRunningTime="2026-05-28 18:34:21.666943459 +0000 UTC m=+492.256553100" watchObservedRunningTime="2026-05-28 18:34:21.668708195 +0000 UTC m=+492.258317837"
May 28 18:34:22.056405 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:22.056365    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:22.061166 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:22.061137    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:22.652460 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:22.652424    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:22.653389 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:22.653369    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd"
May 28 18:34:36.787373 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:36.787338    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7"]
May 28 18:34:36.793144 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:36.793122    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7"
May 28 18:34:36.795458 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:36.795435    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 28 18:34:36.795575 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:36.795471    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 18:34:36.795575 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:36.795557    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 18:34:36.795971 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:36.795954    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ch9dr\""
May 28 18:34:36.802338 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:36.802316    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7"]
May 28 18:34:36.938445 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:36.938410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9nwl\" (UniqueName: \"kubernetes.io/projected/289254f3-46ea-4d2d-ad5e-5aa2dd72d677-kube-api-access-b9nwl\") pod \"dns-operator-controller-manager-648d5c98bc-k24j7\" (UID: \"289254f3-46ea-4d2d-ad5e-5aa2dd72d677\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7"
May 28 18:34:37.039004 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:37.038918    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9nwl\" (UniqueName: \"kubernetes.io/projected/289254f3-46ea-4d2d-ad5e-5aa2dd72d677-kube-api-access-b9nwl\") pod \"dns-operator-controller-manager-648d5c98bc-k24j7\" (UID: \"289254f3-46ea-4d2d-ad5e-5aa2dd72d677\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7"
May 28 18:34:37.051124 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:37.051092    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9nwl\" (UniqueName: \"kubernetes.io/projected/289254f3-46ea-4d2d-ad5e-5aa2dd72d677-kube-api-access-b9nwl\") pod \"dns-operator-controller-manager-648d5c98bc-k24j7\" (UID: \"289254f3-46ea-4d2d-ad5e-5aa2dd72d677\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7"
May 28 18:34:37.105009 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:37.104974    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7"
May 28 18:34:37.239460 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:37.239432    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7"]
May 28 18:34:37.239977 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:34:37.239956    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289254f3_46ea_4d2d_ad5e_5aa2dd72d677.slice/crio-13ebc8ef92eddf1cad45fe12437baa7473ec3e546cc88a4a94875a7fe8b185b4 WatchSource:0}: Error finding container 13ebc8ef92eddf1cad45fe12437baa7473ec3e546cc88a4a94875a7fe8b185b4: Status 404 returned error can't find the container with id 13ebc8ef92eddf1cad45fe12437baa7473ec3e546cc88a4a94875a7fe8b185b4
May 28 18:34:37.701763 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:37.701728    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7" event={"ID":"289254f3-46ea-4d2d-ad5e-5aa2dd72d677","Type":"ContainerStarted","Data":"13ebc8ef92eddf1cad45fe12437baa7473ec3e546cc88a4a94875a7fe8b185b4"}
May 28 18:34:40.672395 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:40.672354    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"]
May 28 18:34:40.674825 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:40.674807    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"
May 28 18:34:40.676879 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:40.676856    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zcghh\""
May 28 18:34:40.686677 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:40.686655    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"]
May 28 18:34:40.714785 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:40.714757    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7" event={"ID":"289254f3-46ea-4d2d-ad5e-5aa2dd72d677","Type":"ContainerStarted","Data":"38600a4663b7ab35ca9979749a763cdf734543e580ee77d6c203d35a5a7e6285"}
May 28 18:34:40.714936 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:40.714923    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7"
May 28 18:34:40.737283 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:40.737234    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7" podStartSLOduration=2.214288262 podStartE2EDuration="4.737220808s" podCreationTimestamp="2026-05-28 18:34:36 +0000 UTC" firstStartedPulling="2026-05-28 18:34:37.241999924 +0000 UTC m=+507.831609545" lastFinishedPulling="2026-05-28 18:34:39.764932473 +0000 UTC m=+510.354542091" observedRunningTime="2026-05-28 18:34:40.735702629 +0000 UTC m=+511.325312269" watchObservedRunningTime="2026-05-28 18:34:40.737220808 +0000 UTC m=+511.326830448"
May 28 18:34:40.771414 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:40.771383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsls8\" (UniqueName: \"kubernetes.io/projected/304d4b1f-9d02-4c8f-ae75-c9fdc149896c-kube-api-access-qsls8\") pod \"limitador-operator-controller-manager-85c4996f8c-sn95b\" (UID: \"304d4b1f-9d02-4c8f-ae75-c9fdc149896c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"
May 28 18:34:40.872609 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:40.872569    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsls8\" (UniqueName: \"kubernetes.io/projected/304d4b1f-9d02-4c8f-ae75-c9fdc149896c-kube-api-access-qsls8\") pod \"limitador-operator-controller-manager-85c4996f8c-sn95b\" (UID: \"304d4b1f-9d02-4c8f-ae75-c9fdc149896c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"
May 28 18:34:40.880311 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:40.880278    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsls8\" (UniqueName: \"kubernetes.io/projected/304d4b1f-9d02-4c8f-ae75-c9fdc149896c-kube-api-access-qsls8\") pod \"limitador-operator-controller-manager-85c4996f8c-sn95b\" (UID: \"304d4b1f-9d02-4c8f-ae75-c9fdc149896c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"
May 28 18:34:40.985008 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:40.984968    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"
May 28 18:34:41.113184 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:41.113154    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"]
May 28 18:34:41.116363 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:34:41.116333    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod304d4b1f_9d02_4c8f_ae75_c9fdc149896c.slice/crio-3dc973778b61c1ea97a0c37cad9c212c36675c78ff2270e9d93d9f4a73a12426 WatchSource:0}: Error finding container 3dc973778b61c1ea97a0c37cad9c212c36675c78ff2270e9d93d9f4a73a12426: Status 404 returned error can't find the container with id 3dc973778b61c1ea97a0c37cad9c212c36675c78ff2270e9d93d9f4a73a12426
May 28 18:34:41.719325 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:41.719285    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" event={"ID":"304d4b1f-9d02-4c8f-ae75-c9fdc149896c","Type":"ContainerStarted","Data":"3dc973778b61c1ea97a0c37cad9c212c36675c78ff2270e9d93d9f4a73a12426"}
May 28 18:34:43.736784 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:43.736750    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" event={"ID":"304d4b1f-9d02-4c8f-ae75-c9fdc149896c","Type":"ContainerStarted","Data":"987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83"}
May 28 18:34:43.737173 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:43.736834    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"
May 28 18:34:43.755479 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:43.755438    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" podStartSLOduration=1.493530915 podStartE2EDuration="3.755421797s" podCreationTimestamp="2026-05-28 18:34:40 +0000 UTC" firstStartedPulling="2026-05-28 18:34:41.118409349 +0000 UTC m=+511.708018970" lastFinishedPulling="2026-05-28 18:34:43.380300233 +0000 UTC m=+513.969909852" observedRunningTime="2026-05-28 18:34:43.754351826 +0000 UTC m=+514.343961467" watchObservedRunningTime="2026-05-28 18:34:43.755421797 +0000 UTC m=+514.345031439"
May 28 18:34:49.452842 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.452802    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"]
May 28 18:34:49.455233 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.455214    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:34:49.457249 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.457224    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2vbj5\""
May 28 18:34:49.465692 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.465667    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"]
May 28 18:34:49.546338 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.546305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/439c8d86-e89d-433a-ab74-b057920e7899-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" (UID: \"439c8d86-e89d-433a-ab74-b057920e7899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:34:49.546482 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.546360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmbzj\" (UniqueName: \"kubernetes.io/projected/439c8d86-e89d-433a-ab74-b057920e7899-kube-api-access-rmbzj\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" (UID: \"439c8d86-e89d-433a-ab74-b057920e7899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:34:49.647091 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.647057    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/439c8d86-e89d-433a-ab74-b057920e7899-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" (UID: \"439c8d86-e89d-433a-ab74-b057920e7899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:34:49.647255 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.647119    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmbzj\" (UniqueName: \"kubernetes.io/projected/439c8d86-e89d-433a-ab74-b057920e7899-kube-api-access-rmbzj\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" (UID: \"439c8d86-e89d-433a-ab74-b057920e7899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:34:49.647434 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.647415    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/439c8d86-e89d-433a-ab74-b057920e7899-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" (UID: \"439c8d86-e89d-433a-ab74-b057920e7899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:34:49.655108 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.655085    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmbzj\" (UniqueName: \"kubernetes.io/projected/439c8d86-e89d-433a-ab74-b057920e7899-kube-api-access-rmbzj\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" (UID: \"439c8d86-e89d-433a-ab74-b057920e7899\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:34:49.765231 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.765143    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:34:49.891455 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:49.891307    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"]
May 28 18:34:49.894596 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:34:49.894569    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439c8d86_e89d_433a_ab74_b057920e7899.slice/crio-744ad0e821b8c3ef3ad9b1303a9997fce2527259d31622889bacc8ac85377a51 WatchSource:0}: Error finding container 744ad0e821b8c3ef3ad9b1303a9997fce2527259d31622889bacc8ac85377a51: Status 404 returned error can't find the container with id 744ad0e821b8c3ef3ad9b1303a9997fce2527259d31622889bacc8ac85377a51
May 28 18:34:50.762884 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:50.762841    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" event={"ID":"439c8d86-e89d-433a-ab74-b057920e7899","Type":"ContainerStarted","Data":"744ad0e821b8c3ef3ad9b1303a9997fce2527259d31622889bacc8ac85377a51"}
May 28 18:34:51.721187 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:51.721151    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-k24j7"
May 28 18:34:54.742993 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:54.742960    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"
May 28 18:34:55.781652 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:55.781613    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" event={"ID":"439c8d86-e89d-433a-ab74-b057920e7899","Type":"ContainerStarted","Data":"5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1"}
May 28 18:34:55.782155 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:55.781765    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:34:55.798920 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:34:55.798874    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" podStartSLOduration=1.479796216 podStartE2EDuration="6.798859135s" podCreationTimestamp="2026-05-28 18:34:49 +0000 UTC" firstStartedPulling="2026-05-28 18:34:49.89690479 +0000 UTC m=+520.486514410" lastFinishedPulling="2026-05-28 18:34:55.215967696 +0000 UTC m=+525.805577329" observedRunningTime="2026-05-28 18:34:55.7981509 +0000 UTC m=+526.387760541" watchObservedRunningTime="2026-05-28 18:34:55.798859135 +0000 UTC m=+526.388468776"
May 28 18:35:06.789317 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:06.789233    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:35:08.487090 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.487049    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"]
May 28 18:35:08.487487 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.487314    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" podUID="439c8d86-e89d-433a-ab74-b057920e7899" containerName="manager" containerID="cri-o://5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1" gracePeriod=2
May 28 18:35:08.489604 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.489561    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.490489 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.490465    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"]
May 28 18:35:08.506132 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.506108    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"]
May 28 18:35:08.506512 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.506418    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439c8d86-e89d-433a-ab74-b057920e7899" containerName="manager"
May 28 18:35:08.506512 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.506428    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="439c8d86-e89d-433a-ab74-b057920e7899" containerName="manager"
May 28 18:35:08.506512 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.506494    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="439c8d86-e89d-433a-ab74-b057920e7899" containerName="manager"
May 28 18:35:08.508401 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.508380    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:08.510353 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.510320    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.522153 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.522127    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"]
May 28 18:35:08.529484 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.529457    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"]
May 28 18:35:08.529708 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.529686    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" containerName="manager" containerID="cri-o://987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83" gracePeriod=2
May 28 18:35:08.539309 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.539281    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"]
May 28 18:35:08.543861 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.543823    2562 status_manager.go:895] "Failed to get status for pod" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" err="pods \"limitador-operator-controller-manager-85c4996f8c-sn95b\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.545420 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.545388    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.556987 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.556965    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p"]
May 28 18:35:08.557290 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.557279    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" containerName="manager"
May 28 18:35:08.557333 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.557292    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" containerName="manager"
May 28 18:35:08.557370 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.557359    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" containerName="manager"
May 28 18:35:08.559336 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.559321    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p"
May 28 18:35:08.571216 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.571191    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p"]
May 28 18:35:08.590549 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.590510    2562 status_manager.go:895] "Failed to get status for pod" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" err="pods \"limitador-operator-controller-manager-85c4996f8c-sn95b\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.592771 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.592741    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.628683 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.628659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzftb\" (UniqueName: \"kubernetes.io/projected/62f4eadf-e968-4d86-9a5f-e3f87c5b2830-kube-api-access-rzftb\") pod \"limitador-operator-controller-manager-85c4996f8c-fnt4p\" (UID: \"62f4eadf-e968-4d86-9a5f-e3f87c5b2830\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p"
May 28 18:35:08.628849 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.628732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beec3a29-1dd8-4738-93d8-977a343b0395-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-stmvz\" (UID: \"beec3a29-1dd8-4738-93d8-977a343b0395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:08.628849 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.628813    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txk69\" (UniqueName: \"kubernetes.io/projected/beec3a29-1dd8-4738-93d8-977a343b0395-kube-api-access-txk69\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-stmvz\" (UID: \"beec3a29-1dd8-4738-93d8-977a343b0395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:08.730155 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.730122    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzftb\" (UniqueName: \"kubernetes.io/projected/62f4eadf-e968-4d86-9a5f-e3f87c5b2830-kube-api-access-rzftb\") pod \"limitador-operator-controller-manager-85c4996f8c-fnt4p\" (UID: \"62f4eadf-e968-4d86-9a5f-e3f87c5b2830\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p"
May 28 18:35:08.730334 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.730214    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beec3a29-1dd8-4738-93d8-977a343b0395-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-stmvz\" (UID: \"beec3a29-1dd8-4738-93d8-977a343b0395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:08.730334 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.730258    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txk69\" (UniqueName: \"kubernetes.io/projected/beec3a29-1dd8-4738-93d8-977a343b0395-kube-api-access-txk69\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-stmvz\" (UID: \"beec3a29-1dd8-4738-93d8-977a343b0395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:08.730706 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.730675    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beec3a29-1dd8-4738-93d8-977a343b0395-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-stmvz\" (UID: \"beec3a29-1dd8-4738-93d8-977a343b0395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:08.749473 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.749449    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txk69\" (UniqueName: \"kubernetes.io/projected/beec3a29-1dd8-4738-93d8-977a343b0395-kube-api-access-txk69\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-stmvz\" (UID: \"beec3a29-1dd8-4738-93d8-977a343b0395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:08.749636 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.749612    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzftb\" (UniqueName: \"kubernetes.io/projected/62f4eadf-e968-4d86-9a5f-e3f87c5b2830-kube-api-access-rzftb\") pod \"limitador-operator-controller-manager-85c4996f8c-fnt4p\" (UID: \"62f4eadf-e968-4d86-9a5f-e3f87c5b2830\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p"
May 28 18:35:08.761068 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.761047    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:35:08.763565 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.763533    2562 status_manager.go:895] "Failed to get status for pod" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" err="pods \"limitador-operator-controller-manager-85c4996f8c-sn95b\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.764080 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.764066    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"
May 28 18:35:08.765604 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.765583    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.767587 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.767564    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.769432 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.769413    2562 status_manager.go:895] "Failed to get status for pod" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" err="pods \"limitador-operator-controller-manager-85c4996f8c-sn95b\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.828707 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.828677    2562 generic.go:358] "Generic (PLEG): container finished" podID="439c8d86-e89d-433a-ab74-b057920e7899" containerID="5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1" exitCode=0
May 28 18:35:08.828880 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.828738    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx"
May 28 18:35:08.828880 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.828779    2562 scope.go:117] "RemoveContainer" containerID="5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1"
May 28 18:35:08.829974 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.829946    2562 generic.go:358] "Generic (PLEG): container finished" podID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" containerID="987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83" exitCode=0
May 28 18:35:08.830078 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.830001    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b"
May 28 18:35:08.830658 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.830633    2562 status_manager.go:895] "Failed to get status for pod" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" err="pods \"limitador-operator-controller-manager-85c4996f8c-sn95b\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.830822 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.830798    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsls8\" (UniqueName: \"kubernetes.io/projected/304d4b1f-9d02-4c8f-ae75-c9fdc149896c-kube-api-access-qsls8\") pod \"304d4b1f-9d02-4c8f-ae75-c9fdc149896c\" (UID: \"304d4b1f-9d02-4c8f-ae75-c9fdc149896c\") "
May 28 18:35:08.830926 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.830897    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/439c8d86-e89d-433a-ab74-b057920e7899-extensions-socket-volume\") pod \"439c8d86-e89d-433a-ab74-b057920e7899\" (UID: \"439c8d86-e89d-433a-ab74-b057920e7899\") "
May 28 18:35:08.830926 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.830922    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmbzj\" (UniqueName: \"kubernetes.io/projected/439c8d86-e89d-433a-ab74-b057920e7899-kube-api-access-rmbzj\") pod \"439c8d86-e89d-433a-ab74-b057920e7899\" (UID: \"439c8d86-e89d-433a-ab74-b057920e7899\") "
May 28 18:35:08.831366 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.831343    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/439c8d86-e89d-433a-ab74-b057920e7899-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "439c8d86-e89d-433a-ab74-b057920e7899" (UID: "439c8d86-e89d-433a-ab74-b057920e7899"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:35:08.832215 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.832192    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.833081 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.833060    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/304d4b1f-9d02-4c8f-ae75-c9fdc149896c-kube-api-access-qsls8" (OuterVolumeSpecName: "kube-api-access-qsls8") pod "304d4b1f-9d02-4c8f-ae75-c9fdc149896c" (UID: "304d4b1f-9d02-4c8f-ae75-c9fdc149896c"). InnerVolumeSpecName "kube-api-access-qsls8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:35:08.833169 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.833096    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/439c8d86-e89d-433a-ab74-b057920e7899-kube-api-access-rmbzj" (OuterVolumeSpecName: "kube-api-access-rmbzj") pod "439c8d86-e89d-433a-ab74-b057920e7899" (UID: "439c8d86-e89d-433a-ab74-b057920e7899"). InnerVolumeSpecName "kube-api-access-rmbzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:35:08.833914 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.833890    2562 status_manager.go:895] "Failed to get status for pod" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" err="pods \"limitador-operator-controller-manager-85c4996f8c-sn95b\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.835344 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.835324    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:08.837383 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.837363    2562 scope.go:117] "RemoveContainer" containerID="5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1"
May 28 18:35:08.837628 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:35:08.837611    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1\": container with ID starting with 5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1 not found: ID does not exist" containerID="5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1"
May 28 18:35:08.837700 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.837642    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1"} err="failed to get container status \"5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1\": rpc error: code = NotFound desc = could not find container \"5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1\": container with ID starting with 5ab1aeba9c49cfc4d497a50b931d258fdd37185b16dbbb1e26b6e28c0521a6b1 not found: ID does not exist"
May 28 18:35:08.837700 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.837658    2562 scope.go:117] "RemoveContainer" containerID="987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83"
May 28 18:35:08.845224 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.845207    2562 scope.go:117] "RemoveContainer" containerID="987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83"
May 28 18:35:08.845634 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:35:08.845617    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83\": container with ID starting with 987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83 not found: ID does not exist" containerID="987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83"
May 28 18:35:08.845674 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.845643    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83"} err="failed to get container status \"987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83\": rpc error: code = NotFound desc = could not find container \"987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83\": container with ID starting with 987b7dd9329bed707053468f39565a73bdde419a5ca0134601d6f70b12a7ea83 not found: ID does not exist"
May 28 18:35:08.916734 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.916689    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:08.922513 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.922493    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p"
May 28 18:35:08.931677 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.931649    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsls8\" (UniqueName: \"kubernetes.io/projected/304d4b1f-9d02-4c8f-ae75-c9fdc149896c-kube-api-access-qsls8\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:35:08.931677 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.931678    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/439c8d86-e89d-433a-ab74-b057920e7899-extensions-socket-volume\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:35:08.931677 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:08.931691    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmbzj\" (UniqueName: \"kubernetes.io/projected/439c8d86-e89d-433a-ab74-b057920e7899-kube-api-access-rmbzj\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:35:09.084451 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.084421    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"]
May 28 18:35:09.087498 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:35:09.087469    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeec3a29_1dd8_4738_93d8_977a343b0395.slice/crio-c795be840fda35d52b9bb3a1ba6d6880545d1760895d1de66d19c39f4465f869 WatchSource:0}: Error finding container c795be840fda35d52b9bb3a1ba6d6880545d1760895d1de66d19c39f4465f869: Status 404 returned error can't find the container with id c795be840fda35d52b9bb3a1ba6d6880545d1760895d1de66d19c39f4465f869
May 28 18:35:09.112671 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.112635    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p"]
May 28 18:35:09.119705 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:35:09.119678    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f4eadf_e968_4d86_9a5f_e3f87c5b2830.slice/crio-06f3d15f2e3b0477ae5ae3c0b39ee487856d668f74e88dd06bdfe5ec5428f380 WatchSource:0}: Error finding container 06f3d15f2e3b0477ae5ae3c0b39ee487856d668f74e88dd06bdfe5ec5428f380: Status 404 returned error can't find the container with id 06f3d15f2e3b0477ae5ae3c0b39ee487856d668f74e88dd06bdfe5ec5428f380
May 28 18:35:09.144292 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.144247    2562 status_manager.go:895] "Failed to get status for pod" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" err="pods \"limitador-operator-controller-manager-85c4996f8c-sn95b\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:09.146140 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.146111    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:09.148170 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.147711    2562 status_manager.go:895] "Failed to get status for pod" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" err="pods \"limitador-operator-controller-manager-85c4996f8c-sn95b\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:09.149628 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.149607    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:09.835231 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.835132    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p" event={"ID":"62f4eadf-e968-4d86-9a5f-e3f87c5b2830","Type":"ContainerStarted","Data":"b352b523482cdbe27ea164d8f4f7668aeb2fd4bcb19fe048d43707b963a83cb4"}
May 28 18:35:09.835231 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.835188    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p"
May 28 18:35:09.835231 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.835203    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p" event={"ID":"62f4eadf-e968-4d86-9a5f-e3f87c5b2830","Type":"ContainerStarted","Data":"06f3d15f2e3b0477ae5ae3c0b39ee487856d668f74e88dd06bdfe5ec5428f380"}
May 28 18:35:09.837398 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.837361    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz" event={"ID":"beec3a29-1dd8-4738-93d8-977a343b0395","Type":"ContainerStarted","Data":"c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c"}
May 28 18:35:09.837521 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.837401    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz" event={"ID":"beec3a29-1dd8-4738-93d8-977a343b0395","Type":"ContainerStarted","Data":"c795be840fda35d52b9bb3a1ba6d6880545d1760895d1de66d19c39f4465f869"}
May 28 18:35:09.837521 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.837471    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:09.858178 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.858134    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p" podStartSLOduration=1.858120874 podStartE2EDuration="1.858120874s" podCreationTimestamp="2026-05-28 18:35:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:35:09.85721713 +0000 UTC m=+540.446826771" watchObservedRunningTime="2026-05-28 18:35:09.858120874 +0000 UTC m=+540.447730514"
May 28 18:35:09.859299 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.859265    2562 status_manager.go:895] "Failed to get status for pod" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" err="pods \"limitador-operator-controller-manager-85c4996f8c-sn95b\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:09.860818 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.860796    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:09.881929 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.881887    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz" podStartSLOduration=1.8818760380000001 podStartE2EDuration="1.881876038s" podCreationTimestamp="2026-05-28 18:35:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:35:09.880394707 +0000 UTC m=+540.470004349" watchObservedRunningTime="2026-05-28 18:35:09.881876038 +0000 UTC m=+540.471485678"
May 28 18:35:09.882861 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.882829    2562 status_manager.go:895] "Failed to get status for pod" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" err="pods \"limitador-operator-controller-manager-85c4996f8c-sn95b\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:09.884350 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:09.884332    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:10.010660 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:10.010614    2562 status_manager.go:895] "Failed to get status for pod" podUID="439c8d86-e89d-433a-ab74-b057920e7899" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vclx" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vclx\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:10.011967 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:10.011931    2562 status_manager.go:895] "Failed to get status for pod" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-sn95b" err="pods \"limitador-operator-controller-manager-85c4996f8c-sn95b\" is forbidden: User \"system:node:ip-10-0-138-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-216.ec2.internal' and this object"
May 28 18:35:10.012086 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:10.012049    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="304d4b1f-9d02-4c8f-ae75-c9fdc149896c" path="/var/lib/kubelet/pods/304d4b1f-9d02-4c8f-ae75-c9fdc149896c/volumes"
May 28 18:35:10.012397 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:10.012384    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="439c8d86-e89d-433a-ab74-b057920e7899" path="/var/lib/kubelet/pods/439c8d86-e89d-433a-ab74-b057920e7899/volumes"
May 28 18:35:20.843518 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:20.843484    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-fnt4p"
May 28 18:35:20.844018 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:20.843551    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:23.542241 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.542197    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"]
May 28 18:35:23.542635 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.542447    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz" podUID="beec3a29-1dd8-4738-93d8-977a343b0395" containerName="manager" containerID="cri-o://c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c" gracePeriod=10
May 28 18:35:23.737056 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.737011    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"]
May 28 18:35:23.741108 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.741086    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:35:23.749829 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.749803    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"]
May 28 18:35:23.762171 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.762141    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk9xs\" (UniqueName: \"kubernetes.io/projected/22d75438-bb34-4a49-af37-7b300e012b18-kube-api-access-qk9xs\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9g8xz\" (UID: \"22d75438-bb34-4a49-af37-7b300e012b18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:35:23.762385 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.762369    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d75438-bb34-4a49-af37-7b300e012b18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9g8xz\" (UID: \"22d75438-bb34-4a49-af37-7b300e012b18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:35:23.799852 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.799804    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:23.862844 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.862810    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beec3a29-1dd8-4738-93d8-977a343b0395-extensions-socket-volume\") pod \"beec3a29-1dd8-4738-93d8-977a343b0395\" (UID: \"beec3a29-1dd8-4738-93d8-977a343b0395\") "
May 28 18:35:23.862981 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.862862    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txk69\" (UniqueName: \"kubernetes.io/projected/beec3a29-1dd8-4738-93d8-977a343b0395-kube-api-access-txk69\") pod \"beec3a29-1dd8-4738-93d8-977a343b0395\" (UID: \"beec3a29-1dd8-4738-93d8-977a343b0395\") "
May 28 18:35:23.862981 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.862923    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qk9xs\" (UniqueName: \"kubernetes.io/projected/22d75438-bb34-4a49-af37-7b300e012b18-kube-api-access-qk9xs\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9g8xz\" (UID: \"22d75438-bb34-4a49-af37-7b300e012b18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:35:23.862981 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.862967    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d75438-bb34-4a49-af37-7b300e012b18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9g8xz\" (UID: \"22d75438-bb34-4a49-af37-7b300e012b18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:35:23.863171 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.863147    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beec3a29-1dd8-4738-93d8-977a343b0395-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "beec3a29-1dd8-4738-93d8-977a343b0395" (UID: "beec3a29-1dd8-4738-93d8-977a343b0395"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:35:23.863381 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.863365    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d75438-bb34-4a49-af37-7b300e012b18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9g8xz\" (UID: \"22d75438-bb34-4a49-af37-7b300e012b18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:35:23.864971 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.864953    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beec3a29-1dd8-4738-93d8-977a343b0395-kube-api-access-txk69" (OuterVolumeSpecName: "kube-api-access-txk69") pod "beec3a29-1dd8-4738-93d8-977a343b0395" (UID: "beec3a29-1dd8-4738-93d8-977a343b0395"). InnerVolumeSpecName "kube-api-access-txk69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:35:23.873458 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.873440    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk9xs\" (UniqueName: \"kubernetes.io/projected/22d75438-bb34-4a49-af37-7b300e012b18-kube-api-access-qk9xs\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9g8xz\" (UID: \"22d75438-bb34-4a49-af37-7b300e012b18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:35:23.887040 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.887017    2562 generic.go:358] "Generic (PLEG): container finished" podID="beec3a29-1dd8-4738-93d8-977a343b0395" containerID="c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c" exitCode=0
May 28 18:35:23.887139 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.887076    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"
May 28 18:35:23.887139 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.887106    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz" event={"ID":"beec3a29-1dd8-4738-93d8-977a343b0395","Type":"ContainerDied","Data":"c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c"}
May 28 18:35:23.887213 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.887145    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz" event={"ID":"beec3a29-1dd8-4738-93d8-977a343b0395","Type":"ContainerDied","Data":"c795be840fda35d52b9bb3a1ba6d6880545d1760895d1de66d19c39f4465f869"}
May 28 18:35:23.887213 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.887165    2562 scope.go:117] "RemoveContainer" containerID="c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c"
May 28 18:35:23.895153 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.895135    2562 scope.go:117] "RemoveContainer" containerID="c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c"
May 28 18:35:23.895403 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:35:23.895386    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c\": container with ID starting with c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c not found: ID does not exist" containerID="c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c"
May 28 18:35:23.895459 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.895409    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c"} err="failed to get container status \"c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c\": rpc error: code = NotFound desc = could not find container \"c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c\": container with ID starting with c1d5c8333bf6b15b3371df6f16051dd05bc5b4a667cb569a8f4176d4c9d46d5c not found: ID does not exist"
May 28 18:35:23.931642 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.931612    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"]
May 28 18:35:23.949328 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.949305    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-stmvz"]
May 28 18:35:23.963828 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.963808    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beec3a29-1dd8-4738-93d8-977a343b0395-extensions-socket-volume\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:35:23.963887 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:23.963831    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txk69\" (UniqueName: \"kubernetes.io/projected/beec3a29-1dd8-4738-93d8-977a343b0395-kube-api-access-txk69\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:35:24.012794 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:24.012763    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beec3a29-1dd8-4738-93d8-977a343b0395" path="/var/lib/kubelet/pods/beec3a29-1dd8-4738-93d8-977a343b0395/volumes"
May 28 18:35:24.054212 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:24.054154    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:35:24.185416 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:24.185285    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"]
May 28 18:35:24.188415 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:35:24.188387    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d75438_bb34_4a49_af37_7b300e012b18.slice/crio-3667329f6829c0b39e9eb6e05ef7a7b16a1421bd70328995c34f592b5d9e8d43 WatchSource:0}: Error finding container 3667329f6829c0b39e9eb6e05ef7a7b16a1421bd70328995c34f592b5d9e8d43: Status 404 returned error can't find the container with id 3667329f6829c0b39e9eb6e05ef7a7b16a1421bd70328995c34f592b5d9e8d43
May 28 18:35:24.893452 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:24.893421    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz" event={"ID":"22d75438-bb34-4a49-af37-7b300e012b18","Type":"ContainerStarted","Data":"5fc69065b5928054c5f2c68b0095be86c04319d0f84214763886840c5c5386d9"}
May 28 18:35:24.893452 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:24.893457    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz" event={"ID":"22d75438-bb34-4a49-af37-7b300e012b18","Type":"ContainerStarted","Data":"3667329f6829c0b39e9eb6e05ef7a7b16a1421bd70328995c34f592b5d9e8d43"}
May 28 18:35:24.894092 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:24.893561    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:35:24.927696 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:24.927640    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz" podStartSLOduration=1.927625267 podStartE2EDuration="1.927625267s" podCreationTimestamp="2026-05-28 18:35:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:35:24.925976119 +0000 UTC m=+555.515585760" watchObservedRunningTime="2026-05-28 18:35:24.927625267 +0000 UTC m=+555.517234909"
May 28 18:35:35.900667 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:35.900629    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:35:39.811318 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.811284    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"]
May 28 18:35:39.812546 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.812513    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beec3a29-1dd8-4738-93d8-977a343b0395" containerName="manager"
May 28 18:35:39.812739 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.812707    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="beec3a29-1dd8-4738-93d8-977a343b0395" containerName="manager"
May 28 18:35:39.813039 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.813024    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="beec3a29-1dd8-4738-93d8-977a343b0395" containerName="manager"
May 28 18:35:39.817080 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.817057    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.821909 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.821888    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bgrkv\""
May 28 18:35:39.833770 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.833716    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"]
May 28 18:35:39.896481 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.896451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.896610 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.896488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.896610 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.896510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.896697 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.896626    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.896765 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.896704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.896765 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.896742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.896765 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.896760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e19a3bc-72cb-477c-8d80-9070941902dd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.896877 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.896779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.896877 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.896836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7cs4\" (UniqueName: \"kubernetes.io/projected/4e19a3bc-72cb-477c-8d80-9070941902dd-kube-api-access-w7cs4\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998126 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998061    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998126 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998125    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998387 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998155    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e19a3bc-72cb-477c-8d80-9070941902dd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998387 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998184    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998387 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998324    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7cs4\" (UniqueName: \"kubernetes.io/projected/4e19a3bc-72cb-477c-8d80-9070941902dd-kube-api-access-w7cs4\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998387 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998375    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998587 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998410    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998587 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998432    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998587 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998492    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998587 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998542    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998858 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998836    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.998984 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998955    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e19a3bc-72cb-477c-8d80-9070941902dd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.999092 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.998992    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:39.999092 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:39.999008    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:40.000564 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.000536    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:40.000655 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.000613    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:40.005680 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.005655    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7cs4\" (UniqueName: \"kubernetes.io/projected/4e19a3bc-72cb-477c-8d80-9070941902dd-kube-api-access-w7cs4\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:40.006228 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.006211    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e19a3bc-72cb-477c-8d80-9070941902dd-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9qtxc\" (UID: \"4e19a3bc-72cb-477c-8d80-9070941902dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:40.127761 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.127671    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:40.258999 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.258963    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"]
May 28 18:35:40.262012 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:35:40.261987    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e19a3bc_72cb_477c_8d80_9070941902dd.slice/crio-661cc3b2b3995e992a245f972c577099a851bb5f44ea0751a740ad4024981d8d WatchSource:0}: Error finding container 661cc3b2b3995e992a245f972c577099a851bb5f44ea0751a740ad4024981d8d: Status 404 returned error can't find the container with id 661cc3b2b3995e992a245f972c577099a851bb5f44ea0751a740ad4024981d8d
May 28 18:35:40.264046 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.264014    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:35:40.264123 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.264079    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:35:40.264123 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.264108    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 28 18:35:40.949538 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.949508    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc" event={"ID":"4e19a3bc-72cb-477c-8d80-9070941902dd","Type":"ContainerStarted","Data":"356c9b615c5f5b2fdf97e556151497fba1dc253494b401d619bbd3f8609d575e"}
May 28 18:35:40.949538 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.949541    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc" event={"ID":"4e19a3bc-72cb-477c-8d80-9070941902dd","Type":"ContainerStarted","Data":"661cc3b2b3995e992a245f972c577099a851bb5f44ea0751a740ad4024981d8d"}
May 28 18:35:40.968368 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:40.968322    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc" podStartSLOduration=1.968308372 podStartE2EDuration="1.968308372s" podCreationTimestamp="2026-05-28 18:35:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:35:40.966662018 +0000 UTC m=+571.556271660" watchObservedRunningTime="2026-05-28 18:35:40.968308372 +0000 UTC m=+571.557918013"
May 28 18:35:41.127863 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:41.127829    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:41.129489 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:41.129464    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
May 28 18:35:41.129632 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:41.129510    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc" podUID="4e19a3bc-72cb-477c-8d80-9070941902dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
May 28 18:35:42.132630 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:42.132600    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:42.956245 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:42.956218    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:42.957268 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:42.957250    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9qtxc"
May 28 18:35:54.126863 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.126827    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-k99nl"]
May 28 18:35:54.130641 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.130617    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-k99nl"
May 28 18:35:54.132537 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.132515    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7ztbk\""
May 28 18:35:54.136033 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.136010    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-k99nl"]
May 28 18:35:54.231149 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.231112    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6s7n\" (UniqueName: \"kubernetes.io/projected/03714b06-3ad2-413e-aa15-c8686fd47991-kube-api-access-p6s7n\") pod \"authorino-f99f4b5cd-k99nl\" (UID: \"03714b06-3ad2-413e-aa15-c8686fd47991\") " pod="kuadrant-system/authorino-f99f4b5cd-k99nl"
May 28 18:35:54.332024 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.331990    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6s7n\" (UniqueName: \"kubernetes.io/projected/03714b06-3ad2-413e-aa15-c8686fd47991-kube-api-access-p6s7n\") pod \"authorino-f99f4b5cd-k99nl\" (UID: \"03714b06-3ad2-413e-aa15-c8686fd47991\") " pod="kuadrant-system/authorino-f99f4b5cd-k99nl"
May 28 18:35:54.339072 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.339046    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6s7n\" (UniqueName: \"kubernetes.io/projected/03714b06-3ad2-413e-aa15-c8686fd47991-kube-api-access-p6s7n\") pod \"authorino-f99f4b5cd-k99nl\" (UID: \"03714b06-3ad2-413e-aa15-c8686fd47991\") " pod="kuadrant-system/authorino-f99f4b5cd-k99nl"
May 28 18:35:54.357852 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.357824    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-54qx8"]
May 28 18:35:54.361207 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.361188    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-54qx8"
May 28 18:35:54.365250 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.365225    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-54qx8"]
May 28 18:35:54.432687 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.432597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjf8c\" (UniqueName: \"kubernetes.io/projected/f681bac1-0cc0-4d7a-bbc7-588a51d79fa6-kube-api-access-zjf8c\") pod \"authorino-7498df8756-54qx8\" (UID: \"f681bac1-0cc0-4d7a-bbc7-588a51d79fa6\") " pod="kuadrant-system/authorino-7498df8756-54qx8"
May 28 18:35:54.441484 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.441458    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-k99nl"
May 28 18:35:54.533441 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.533396    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjf8c\" (UniqueName: \"kubernetes.io/projected/f681bac1-0cc0-4d7a-bbc7-588a51d79fa6-kube-api-access-zjf8c\") pod \"authorino-7498df8756-54qx8\" (UID: \"f681bac1-0cc0-4d7a-bbc7-588a51d79fa6\") " pod="kuadrant-system/authorino-7498df8756-54qx8"
May 28 18:35:54.541143 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.541113    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjf8c\" (UniqueName: \"kubernetes.io/projected/f681bac1-0cc0-4d7a-bbc7-588a51d79fa6-kube-api-access-zjf8c\") pod \"authorino-7498df8756-54qx8\" (UID: \"f681bac1-0cc0-4d7a-bbc7-588a51d79fa6\") " pod="kuadrant-system/authorino-7498df8756-54qx8"
May 28 18:35:54.565751 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.565701    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-k99nl"]
May 28 18:35:54.568093 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:35:54.568068    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03714b06_3ad2_413e_aa15_c8686fd47991.slice/crio-5fa6497a91fea948ecf883d353bb4a6ccf959606c8ed6bcd17323dbfae1d54b7 WatchSource:0}: Error finding container 5fa6497a91fea948ecf883d353bb4a6ccf959606c8ed6bcd17323dbfae1d54b7: Status 404 returned error can't find the container with id 5fa6497a91fea948ecf883d353bb4a6ccf959606c8ed6bcd17323dbfae1d54b7
May 28 18:35:54.671561 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.671527    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-54qx8"
May 28 18:35:54.792308 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.792280    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-54qx8"]
May 28 18:35:54.794106 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:35:54.794079    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf681bac1_0cc0_4d7a_bbc7_588a51d79fa6.slice/crio-eff7a529ded2125848e7b2c940ab7aa72106c06eb93fdfe21e65f216ac1efd03 WatchSource:0}: Error finding container eff7a529ded2125848e7b2c940ab7aa72106c06eb93fdfe21e65f216ac1efd03: Status 404 returned error can't find the container with id eff7a529ded2125848e7b2c940ab7aa72106c06eb93fdfe21e65f216ac1efd03
May 28 18:35:54.995933 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.995843    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-k99nl" event={"ID":"03714b06-3ad2-413e-aa15-c8686fd47991","Type":"ContainerStarted","Data":"5fa6497a91fea948ecf883d353bb4a6ccf959606c8ed6bcd17323dbfae1d54b7"}
May 28 18:35:54.996763 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:54.996740    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-54qx8" event={"ID":"f681bac1-0cc0-4d7a-bbc7-588a51d79fa6","Type":"ContainerStarted","Data":"eff7a529ded2125848e7b2c940ab7aa72106c06eb93fdfe21e65f216ac1efd03"}
May 28 18:35:59.018438 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:59.018399    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-k99nl" event={"ID":"03714b06-3ad2-413e-aa15-c8686fd47991","Type":"ContainerStarted","Data":"b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b"}
May 28 18:35:59.019635 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:59.019611    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-54qx8" event={"ID":"f681bac1-0cc0-4d7a-bbc7-588a51d79fa6","Type":"ContainerStarted","Data":"d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b"}
May 28 18:35:59.035445 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:59.035394    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-k99nl" podStartSLOduration=1.397493564 podStartE2EDuration="5.035381051s" podCreationTimestamp="2026-05-28 18:35:54 +0000 UTC" firstStartedPulling="2026-05-28 18:35:54.569446384 +0000 UTC m=+585.159056002" lastFinishedPulling="2026-05-28 18:35:58.207333857 +0000 UTC m=+588.796943489" observedRunningTime="2026-05-28 18:35:59.033390494 +0000 UTC m=+589.623000134" watchObservedRunningTime="2026-05-28 18:35:59.035381051 +0000 UTC m=+589.624990692"
May 28 18:35:59.051473 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:59.051108    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-54qx8" podStartSLOduration=1.653779629 podStartE2EDuration="5.05109158s" podCreationTimestamp="2026-05-28 18:35:54 +0000 UTC" firstStartedPulling="2026-05-28 18:35:54.795295288 +0000 UTC m=+585.384904907" lastFinishedPulling="2026-05-28 18:35:58.192607236 +0000 UTC m=+588.782216858" observedRunningTime="2026-05-28 18:35:59.05022286 +0000 UTC m=+589.639832501" watchObservedRunningTime="2026-05-28 18:35:59.05109158 +0000 UTC m=+589.640701222"
May 28 18:35:59.075556 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:35:59.075522    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-k99nl"]
May 28 18:36:01.025489 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:01.025428    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-k99nl" podUID="03714b06-3ad2-413e-aa15-c8686fd47991" containerName="authorino" containerID="cri-o://b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b" gracePeriod=30
May 28 18:36:01.278846 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:01.278778    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-k99nl"
May 28 18:36:01.397879 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:01.397835    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6s7n\" (UniqueName: \"kubernetes.io/projected/03714b06-3ad2-413e-aa15-c8686fd47991-kube-api-access-p6s7n\") pod \"03714b06-3ad2-413e-aa15-c8686fd47991\" (UID: \"03714b06-3ad2-413e-aa15-c8686fd47991\") "
May 28 18:36:01.400099 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:01.400060    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03714b06-3ad2-413e-aa15-c8686fd47991-kube-api-access-p6s7n" (OuterVolumeSpecName: "kube-api-access-p6s7n") pod "03714b06-3ad2-413e-aa15-c8686fd47991" (UID: "03714b06-3ad2-413e-aa15-c8686fd47991"). InnerVolumeSpecName "kube-api-access-p6s7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:36:01.498600 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:01.498562    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6s7n\" (UniqueName: \"kubernetes.io/projected/03714b06-3ad2-413e-aa15-c8686fd47991-kube-api-access-p6s7n\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:36:02.029258 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:02.029224    2562 generic.go:358] "Generic (PLEG): container finished" podID="03714b06-3ad2-413e-aa15-c8686fd47991" containerID="b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b" exitCode=0
May 28 18:36:02.029626 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:02.029261    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-k99nl" event={"ID":"03714b06-3ad2-413e-aa15-c8686fd47991","Type":"ContainerDied","Data":"b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b"}
May 28 18:36:02.029626 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:02.029271    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-k99nl"
May 28 18:36:02.029626 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:02.029283    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-k99nl" event={"ID":"03714b06-3ad2-413e-aa15-c8686fd47991","Type":"ContainerDied","Data":"5fa6497a91fea948ecf883d353bb4a6ccf959606c8ed6bcd17323dbfae1d54b7"}
May 28 18:36:02.029626 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:02.029298    2562 scope.go:117] "RemoveContainer" containerID="b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b"
May 28 18:36:02.037381 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:02.037365    2562 scope.go:117] "RemoveContainer" containerID="b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b"
May 28 18:36:02.037613 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:36:02.037594    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b\": container with ID starting with b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b not found: ID does not exist" containerID="b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b"
May 28 18:36:02.037669 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:02.037620    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b"} err="failed to get container status \"b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b\": rpc error: code = NotFound desc = could not find container \"b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b\": container with ID starting with b72673120c6227e35ac92abdddd8973e2d0a54517827f4f14c9abffc6cfb2a3b not found: ID does not exist"
May 28 18:36:02.043548 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:02.043526    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-k99nl"]
May 28 18:36:02.046969 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:02.046952    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-k99nl"]
May 28 18:36:04.012789 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:04.012750    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03714b06-3ad2-413e-aa15-c8686fd47991" path="/var/lib/kubelet/pods/03714b06-3ad2-413e-aa15-c8686fd47991/volumes"
May 28 18:36:09.947378 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:09.947341    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:36:09.947814 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:09.947470    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:36:09.950605 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:09.950587    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:36:09.950750 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:09.950680    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:36:23.271124 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.271088    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-692j5"]
May 28 18:36:23.271566 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.271454    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03714b06-3ad2-413e-aa15-c8686fd47991" containerName="authorino"
May 28 18:36:23.271566 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.271467    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="03714b06-3ad2-413e-aa15-c8686fd47991" containerName="authorino"
May 28 18:36:23.271566 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.271551    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="03714b06-3ad2-413e-aa15-c8686fd47991" containerName="authorino"
May 28 18:36:23.276493 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.276472    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-692j5"
May 28 18:36:23.280398 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.280371    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-692j5"]
May 28 18:36:23.399119 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.399083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvkjl\" (UniqueName: \"kubernetes.io/projected/7dffea78-5c79-4602-b5b6-286d0ed5b745-kube-api-access-mvkjl\") pod \"authorino-8b475cf9f-692j5\" (UID: \"7dffea78-5c79-4602-b5b6-286d0ed5b745\") " pod="kuadrant-system/authorino-8b475cf9f-692j5"
May 28 18:36:23.500438 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.500404    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvkjl\" (UniqueName: \"kubernetes.io/projected/7dffea78-5c79-4602-b5b6-286d0ed5b745-kube-api-access-mvkjl\") pod \"authorino-8b475cf9f-692j5\" (UID: \"7dffea78-5c79-4602-b5b6-286d0ed5b745\") " pod="kuadrant-system/authorino-8b475cf9f-692j5"
May 28 18:36:23.505493 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.505450    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-692j5"]
May 28 18:36:23.505839 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:36:23.505813    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mvkjl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-692j5" podUID="7dffea78-5c79-4602-b5b6-286d0ed5b745"
May 28 18:36:23.508434 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.508409    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvkjl\" (UniqueName: \"kubernetes.io/projected/7dffea78-5c79-4602-b5b6-286d0ed5b745-kube-api-access-mvkjl\") pod \"authorino-8b475cf9f-692j5\" (UID: \"7dffea78-5c79-4602-b5b6-286d0ed5b745\") " pod="kuadrant-system/authorino-8b475cf9f-692j5"
May 28 18:36:23.529062 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.528973    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d84f6448-4tnqc"]
May 28 18:36:23.531365 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.531344    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d84f6448-4tnqc"
May 28 18:36:23.537918 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.537889    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d84f6448-4tnqc"]
May 28 18:36:23.601709 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.601667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk5rf\" (UniqueName: \"kubernetes.io/projected/41faae28-1b98-48ce-8cbc-e585b0797028-kube-api-access-nk5rf\") pod \"authorino-5d84f6448-4tnqc\" (UID: \"41faae28-1b98-48ce-8cbc-e585b0797028\") " pod="kuadrant-system/authorino-5d84f6448-4tnqc"
May 28 18:36:23.703102 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.703061    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nk5rf\" (UniqueName: \"kubernetes.io/projected/41faae28-1b98-48ce-8cbc-e585b0797028-kube-api-access-nk5rf\") pod \"authorino-5d84f6448-4tnqc\" (UID: \"41faae28-1b98-48ce-8cbc-e585b0797028\") " pod="kuadrant-system/authorino-5d84f6448-4tnqc"
May 28 18:36:23.711342 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.711307    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk5rf\" (UniqueName: \"kubernetes.io/projected/41faae28-1b98-48ce-8cbc-e585b0797028-kube-api-access-nk5rf\") pod \"authorino-5d84f6448-4tnqc\" (UID: \"41faae28-1b98-48ce-8cbc-e585b0797028\") " pod="kuadrant-system/authorino-5d84f6448-4tnqc"
May 28 18:36:23.842585 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.842492    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d84f6448-4tnqc"
May 28 18:36:23.975135 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:23.974946    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d84f6448-4tnqc"]
May 28 18:36:23.977865 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:36:23.977837    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41faae28_1b98_48ce_8cbc_e585b0797028.slice/crio-1c655e6fce07c81010d914712d343651d7db1b8ef40bb9f73610ea2467944d04 WatchSource:0}: Error finding container 1c655e6fce07c81010d914712d343651d7db1b8ef40bb9f73610ea2467944d04: Status 404 returned error can't find the container with id 1c655e6fce07c81010d914712d343651d7db1b8ef40bb9f73610ea2467944d04
May 28 18:36:24.103203 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:24.103126    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-692j5"
May 28 18:36:24.103342 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:24.103126    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d84f6448-4tnqc" event={"ID":"41faae28-1b98-48ce-8cbc-e585b0797028","Type":"ContainerStarted","Data":"1c655e6fce07c81010d914712d343651d7db1b8ef40bb9f73610ea2467944d04"}
May 28 18:36:24.108040 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:24.108019    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-692j5"
May 28 18:36:24.207701 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:24.207668    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvkjl\" (UniqueName: \"kubernetes.io/projected/7dffea78-5c79-4602-b5b6-286d0ed5b745-kube-api-access-mvkjl\") pod \"7dffea78-5c79-4602-b5b6-286d0ed5b745\" (UID: \"7dffea78-5c79-4602-b5b6-286d0ed5b745\") "
May 28 18:36:24.209849 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:24.209821    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dffea78-5c79-4602-b5b6-286d0ed5b745-kube-api-access-mvkjl" (OuterVolumeSpecName: "kube-api-access-mvkjl") pod "7dffea78-5c79-4602-b5b6-286d0ed5b745" (UID: "7dffea78-5c79-4602-b5b6-286d0ed5b745"). InnerVolumeSpecName "kube-api-access-mvkjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:36:24.308895 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:24.308865    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvkjl\" (UniqueName: \"kubernetes.io/projected/7dffea78-5c79-4602-b5b6-286d0ed5b745-kube-api-access-mvkjl\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:36:25.108096 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.108058    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d84f6448-4tnqc" event={"ID":"41faae28-1b98-48ce-8cbc-e585b0797028","Type":"ContainerStarted","Data":"5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e"}
May 28 18:36:25.108277 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.108126    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-692j5"
May 28 18:36:25.126433 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.126377    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5d84f6448-4tnqc" podStartSLOduration=1.8281028 podStartE2EDuration="2.126363375s" podCreationTimestamp="2026-05-28 18:36:23 +0000 UTC" firstStartedPulling="2026-05-28 18:36:23.979167878 +0000 UTC m=+614.568777500" lastFinishedPulling="2026-05-28 18:36:24.27742845 +0000 UTC m=+614.867038075" observedRunningTime="2026-05-28 18:36:25.124511749 +0000 UTC m=+615.714121392" watchObservedRunningTime="2026-05-28 18:36:25.126363375 +0000 UTC m=+615.715973015"
May 28 18:36:25.148808 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.148774    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-692j5"]
May 28 18:36:25.151823 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.151230    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-54qx8"]
May 28 18:36:25.151823 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.151485    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-54qx8" podUID="f681bac1-0cc0-4d7a-bbc7-588a51d79fa6" containerName="authorino" containerID="cri-o://d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b" gracePeriod=30
May 28 18:36:25.154898 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.154870    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-692j5"]
May 28 18:36:25.356455 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.356423    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57c5878fd4-6q9s9"]
May 28 18:36:25.359188 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.359133    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c5878fd4-6q9s9"
May 28 18:36:25.361313 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.361293    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 28 18:36:25.367573 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.367553    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57c5878fd4-6q9s9"]
May 28 18:36:25.407749 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.407709    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-54qx8"
May 28 18:36:25.420853 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.420821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce47df57-3777-4fe1-93bd-41323b3fa78a-tls-cert\") pod \"authorino-57c5878fd4-6q9s9\" (UID: \"ce47df57-3777-4fe1-93bd-41323b3fa78a\") " pod="kuadrant-system/authorino-57c5878fd4-6q9s9"
May 28 18:36:25.421018 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.420863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdkzf\" (UniqueName: \"kubernetes.io/projected/ce47df57-3777-4fe1-93bd-41323b3fa78a-kube-api-access-kdkzf\") pod \"authorino-57c5878fd4-6q9s9\" (UID: \"ce47df57-3777-4fe1-93bd-41323b3fa78a\") " pod="kuadrant-system/authorino-57c5878fd4-6q9s9"
May 28 18:36:25.522213 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.522177    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjf8c\" (UniqueName: \"kubernetes.io/projected/f681bac1-0cc0-4d7a-bbc7-588a51d79fa6-kube-api-access-zjf8c\") pod \"f681bac1-0cc0-4d7a-bbc7-588a51d79fa6\" (UID: \"f681bac1-0cc0-4d7a-bbc7-588a51d79fa6\") "
May 28 18:36:25.522382 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.522311    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce47df57-3777-4fe1-93bd-41323b3fa78a-tls-cert\") pod \"authorino-57c5878fd4-6q9s9\" (UID: \"ce47df57-3777-4fe1-93bd-41323b3fa78a\") " pod="kuadrant-system/authorino-57c5878fd4-6q9s9"
May 28 18:36:25.522382 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.522333    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdkzf\" (UniqueName: \"kubernetes.io/projected/ce47df57-3777-4fe1-93bd-41323b3fa78a-kube-api-access-kdkzf\") pod \"authorino-57c5878fd4-6q9s9\" (UID: \"ce47df57-3777-4fe1-93bd-41323b3fa78a\") " pod="kuadrant-system/authorino-57c5878fd4-6q9s9"
May 28 18:36:25.524378 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.524341    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f681bac1-0cc0-4d7a-bbc7-588a51d79fa6-kube-api-access-zjf8c" (OuterVolumeSpecName: "kube-api-access-zjf8c") pod "f681bac1-0cc0-4d7a-bbc7-588a51d79fa6" (UID: "f681bac1-0cc0-4d7a-bbc7-588a51d79fa6"). InnerVolumeSpecName "kube-api-access-zjf8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:36:25.524766 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.524746    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce47df57-3777-4fe1-93bd-41323b3fa78a-tls-cert\") pod \"authorino-57c5878fd4-6q9s9\" (UID: \"ce47df57-3777-4fe1-93bd-41323b3fa78a\") " pod="kuadrant-system/authorino-57c5878fd4-6q9s9"
May 28 18:36:25.529611 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.529586    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdkzf\" (UniqueName: \"kubernetes.io/projected/ce47df57-3777-4fe1-93bd-41323b3fa78a-kube-api-access-kdkzf\") pod \"authorino-57c5878fd4-6q9s9\" (UID: \"ce47df57-3777-4fe1-93bd-41323b3fa78a\") " pod="kuadrant-system/authorino-57c5878fd4-6q9s9"
May 28 18:36:25.623757 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.623630    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjf8c\" (UniqueName: \"kubernetes.io/projected/f681bac1-0cc0-4d7a-bbc7-588a51d79fa6-kube-api-access-zjf8c\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:36:25.669553 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.669513    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c5878fd4-6q9s9"
May 28 18:36:25.807529 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:25.807450    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57c5878fd4-6q9s9"]
May 28 18:36:25.810169 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:36:25.810140    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce47df57_3777_4fe1_93bd_41323b3fa78a.slice/crio-c2b73b1df6d0111892052cad52545e6e8ee186bf2cb0387c029c752d6a8c77c1 WatchSource:0}: Error finding container c2b73b1df6d0111892052cad52545e6e8ee186bf2cb0387c029c752d6a8c77c1: Status 404 returned error can't find the container with id c2b73b1df6d0111892052cad52545e6e8ee186bf2cb0387c029c752d6a8c77c1
May 28 18:36:26.012668 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:26.012624    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dffea78-5c79-4602-b5b6-286d0ed5b745" path="/var/lib/kubelet/pods/7dffea78-5c79-4602-b5b6-286d0ed5b745/volumes"
May 28 18:36:26.113127 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:26.113094    2562 generic.go:358] "Generic (PLEG): container finished" podID="f681bac1-0cc0-4d7a-bbc7-588a51d79fa6" containerID="d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b" exitCode=0
May 28 18:36:26.113295 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:26.113141    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-54qx8"
May 28 18:36:26.113295 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:26.113167    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-54qx8" event={"ID":"f681bac1-0cc0-4d7a-bbc7-588a51d79fa6","Type":"ContainerDied","Data":"d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b"}
May 28 18:36:26.113295 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:26.113207    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-54qx8" event={"ID":"f681bac1-0cc0-4d7a-bbc7-588a51d79fa6","Type":"ContainerDied","Data":"eff7a529ded2125848e7b2c940ab7aa72106c06eb93fdfe21e65f216ac1efd03"}
May 28 18:36:26.113295 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:26.113225    2562 scope.go:117] "RemoveContainer" containerID="d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b"
May 28 18:36:26.114390 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:26.114362    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c5878fd4-6q9s9" event={"ID":"ce47df57-3777-4fe1-93bd-41323b3fa78a","Type":"ContainerStarted","Data":"c2b73b1df6d0111892052cad52545e6e8ee186bf2cb0387c029c752d6a8c77c1"}
May 28 18:36:26.121265 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:26.121244    2562 scope.go:117] "RemoveContainer" containerID="d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b"
May 28 18:36:26.121503 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:36:26.121483    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b\": container with ID starting with d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b not found: ID does not exist" containerID="d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b"
May 28 18:36:26.121577 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:26.121510    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b"} err="failed to get container status \"d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b\": rpc error: code = NotFound desc = could not find container \"d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b\": container with ID starting with d5600740b47890d0c64b140ff14b23d5d9dd5b39ea4105c3adeb31841d962e5b not found: ID does not exist"
May 28 18:36:26.127494 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:26.127467    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-54qx8"]
May 28 18:36:26.131002 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:26.130981    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-54qx8"]
May 28 18:36:27.118941 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:27.118844    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c5878fd4-6q9s9" event={"ID":"ce47df57-3777-4fe1-93bd-41323b3fa78a","Type":"ContainerStarted","Data":"abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638"}
May 28 18:36:27.134029 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:27.133982    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-57c5878fd4-6q9s9" podStartSLOduration=1.788060411 podStartE2EDuration="2.13396815s" podCreationTimestamp="2026-05-28 18:36:25 +0000 UTC" firstStartedPulling="2026-05-28 18:36:25.81153796 +0000 UTC m=+616.401147578" lastFinishedPulling="2026-05-28 18:36:26.157445687 +0000 UTC m=+616.747055317" observedRunningTime="2026-05-28 18:36:27.131672934 +0000 UTC m=+617.721282576" watchObservedRunningTime="2026-05-28 18:36:27.13396815 +0000 UTC m=+617.723577792"
May 28 18:36:27.156645 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:27.156610    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d84f6448-4tnqc"]
May 28 18:36:27.156897 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:27.156860    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5d84f6448-4tnqc" podUID="41faae28-1b98-48ce-8cbc-e585b0797028" containerName="authorino" containerID="cri-o://5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e" gracePeriod=30
May 28 18:36:27.405826 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:27.405804    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d84f6448-4tnqc"
May 28 18:36:27.540821 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:27.540786    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk5rf\" (UniqueName: \"kubernetes.io/projected/41faae28-1b98-48ce-8cbc-e585b0797028-kube-api-access-nk5rf\") pod \"41faae28-1b98-48ce-8cbc-e585b0797028\" (UID: \"41faae28-1b98-48ce-8cbc-e585b0797028\") "
May 28 18:36:27.542870 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:27.542843    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41faae28-1b98-48ce-8cbc-e585b0797028-kube-api-access-nk5rf" (OuterVolumeSpecName: "kube-api-access-nk5rf") pod "41faae28-1b98-48ce-8cbc-e585b0797028" (UID: "41faae28-1b98-48ce-8cbc-e585b0797028"). InnerVolumeSpecName "kube-api-access-nk5rf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:36:27.642458 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:27.642373    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk5rf\" (UniqueName: \"kubernetes.io/projected/41faae28-1b98-48ce-8cbc-e585b0797028-kube-api-access-nk5rf\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:36:28.012352 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:28.012316    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f681bac1-0cc0-4d7a-bbc7-588a51d79fa6" path="/var/lib/kubelet/pods/f681bac1-0cc0-4d7a-bbc7-588a51d79fa6/volumes"
May 28 18:36:28.124508 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:28.124473    2562 generic.go:358] "Generic (PLEG): container finished" podID="41faae28-1b98-48ce-8cbc-e585b0797028" containerID="5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e" exitCode=0
May 28 18:36:28.124925 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:28.124536    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d84f6448-4tnqc"
May 28 18:36:28.124925 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:28.124560    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d84f6448-4tnqc" event={"ID":"41faae28-1b98-48ce-8cbc-e585b0797028","Type":"ContainerDied","Data":"5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e"}
May 28 18:36:28.124925 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:28.124599    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d84f6448-4tnqc" event={"ID":"41faae28-1b98-48ce-8cbc-e585b0797028","Type":"ContainerDied","Data":"1c655e6fce07c81010d914712d343651d7db1b8ef40bb9f73610ea2467944d04"}
May 28 18:36:28.124925 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:28.124616    2562 scope.go:117] "RemoveContainer" containerID="5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e"
May 28 18:36:28.132708 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:28.132689    2562 scope.go:117] "RemoveContainer" containerID="5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e"
May 28 18:36:28.132982 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:36:28.132961    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e\": container with ID starting with 5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e not found: ID does not exist" containerID="5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e"
May 28 18:36:28.133030 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:28.132989    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e"} err="failed to get container status \"5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e\": rpc error: code = NotFound desc = could not find container \"5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e\": container with ID starting with 5867ab689c602347ca3ef621c503c83f110e108dc9a3dea3bfb3fe737abc8b9e not found: ID does not exist"
May 28 18:36:28.139883 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:28.139861    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d84f6448-4tnqc"]
May 28 18:36:28.144266 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:28.144248    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d84f6448-4tnqc"]
May 28 18:36:30.012381 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:36:30.012341    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41faae28-1b98-48ce-8cbc-e585b0797028" path="/var/lib/kubelet/pods/41faae28-1b98-48ce-8cbc-e585b0797028/volumes"
May 28 18:39:05.927102 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:05.927066    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86d5545665-bsjk6"]
May 28 18:39:05.927490 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:05.927430    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f681bac1-0cc0-4d7a-bbc7-588a51d79fa6" containerName="authorino"
May 28 18:39:05.927490 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:05.927442    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f681bac1-0cc0-4d7a-bbc7-588a51d79fa6" containerName="authorino"
May 28 18:39:05.927490 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:05.927464    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41faae28-1b98-48ce-8cbc-e585b0797028" containerName="authorino"
May 28 18:39:05.927490 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:05.927470    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="41faae28-1b98-48ce-8cbc-e585b0797028" containerName="authorino"
May 28 18:39:05.927614 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:05.927522    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="41faae28-1b98-48ce-8cbc-e585b0797028" containerName="authorino"
May 28 18:39:05.927614 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:05.927532    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f681bac1-0cc0-4d7a-bbc7-588a51d79fa6" containerName="authorino"
May 28 18:39:05.929672 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:05.929653    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d5545665-bsjk6"
May 28 18:39:05.936056 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:05.936031    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86d5545665-bsjk6"]
May 28 18:39:06.084470 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:06.084431    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac283ac2-94ee-45f6-ae6c-f6535017ca3e-tls-cert\") pod \"authorino-86d5545665-bsjk6\" (UID: \"ac283ac2-94ee-45f6-ae6c-f6535017ca3e\") " pod="kuadrant-system/authorino-86d5545665-bsjk6"
May 28 18:39:06.084790 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:06.084766    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmbz6\" (UniqueName: \"kubernetes.io/projected/ac283ac2-94ee-45f6-ae6c-f6535017ca3e-kube-api-access-cmbz6\") pod \"authorino-86d5545665-bsjk6\" (UID: \"ac283ac2-94ee-45f6-ae6c-f6535017ca3e\") " pod="kuadrant-system/authorino-86d5545665-bsjk6"
May 28 18:39:06.185445 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:06.185358    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmbz6\" (UniqueName: \"kubernetes.io/projected/ac283ac2-94ee-45f6-ae6c-f6535017ca3e-kube-api-access-cmbz6\") pod \"authorino-86d5545665-bsjk6\" (UID: \"ac283ac2-94ee-45f6-ae6c-f6535017ca3e\") " pod="kuadrant-system/authorino-86d5545665-bsjk6"
May 28 18:39:06.185577 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:06.185549    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac283ac2-94ee-45f6-ae6c-f6535017ca3e-tls-cert\") pod \"authorino-86d5545665-bsjk6\" (UID: \"ac283ac2-94ee-45f6-ae6c-f6535017ca3e\") " pod="kuadrant-system/authorino-86d5545665-bsjk6"
May 28 18:39:06.188040 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:06.188011    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ac283ac2-94ee-45f6-ae6c-f6535017ca3e-tls-cert\") pod \"authorino-86d5545665-bsjk6\" (UID: \"ac283ac2-94ee-45f6-ae6c-f6535017ca3e\") " pod="kuadrant-system/authorino-86d5545665-bsjk6"
May 28 18:39:06.192571 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:06.192532    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmbz6\" (UniqueName: \"kubernetes.io/projected/ac283ac2-94ee-45f6-ae6c-f6535017ca3e-kube-api-access-cmbz6\") pod \"authorino-86d5545665-bsjk6\" (UID: \"ac283ac2-94ee-45f6-ae6c-f6535017ca3e\") " pod="kuadrant-system/authorino-86d5545665-bsjk6"
May 28 18:39:06.239347 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:06.239308    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86d5545665-bsjk6"
May 28 18:39:06.377249 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:06.377223    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86d5545665-bsjk6"]
May 28 18:39:06.379856 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:39:06.379827    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac283ac2_94ee_45f6_ae6c_f6535017ca3e.slice/crio-08437af297607d68a6491f54dff67df618e3074fc20a2d36b478485ea50d30d2 WatchSource:0}: Error finding container 08437af297607d68a6491f54dff67df618e3074fc20a2d36b478485ea50d30d2: Status 404 returned error can't find the container with id 08437af297607d68a6491f54dff67df618e3074fc20a2d36b478485ea50d30d2
May 28 18:39:06.381502 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:06.381485    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:39:06.692245 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:06.692191    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d5545665-bsjk6" event={"ID":"ac283ac2-94ee-45f6-ae6c-f6535017ca3e","Type":"ContainerStarted","Data":"08437af297607d68a6491f54dff67df618e3074fc20a2d36b478485ea50d30d2"}
May 28 18:39:07.697622 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:07.697577    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86d5545665-bsjk6" event={"ID":"ac283ac2-94ee-45f6-ae6c-f6535017ca3e","Type":"ContainerStarted","Data":"728bc66b93814b81cc35915116c77a7f28f62ab88f8a3558a6e9f0b0ed553621"}
May 28 18:39:07.716292 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:07.716238    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-86d5545665-bsjk6" podStartSLOduration=2.316922915 podStartE2EDuration="2.716223164s" podCreationTimestamp="2026-05-28 18:39:05 +0000 UTC" firstStartedPulling="2026-05-28 18:39:06.381605085 +0000 UTC m=+776.971214704" lastFinishedPulling="2026-05-28 18:39:06.780905334 +0000 UTC m=+777.370514953" observedRunningTime="2026-05-28 18:39:07.714347692 +0000 UTC m=+778.303957332" watchObservedRunningTime="2026-05-28 18:39:07.716223164 +0000 UTC m=+778.305832805"
May 28 18:39:07.738103 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:07.738070    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57c5878fd4-6q9s9"]
May 28 18:39:07.738334 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:07.738289    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-57c5878fd4-6q9s9" podUID="ce47df57-3777-4fe1-93bd-41323b3fa78a" containerName="authorino" containerID="cri-o://abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638" gracePeriod=30
May 28 18:39:07.998809 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:07.998780    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c5878fd4-6q9s9"
May 28 18:39:08.103189 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.103153    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce47df57-3777-4fe1-93bd-41323b3fa78a-tls-cert\") pod \"ce47df57-3777-4fe1-93bd-41323b3fa78a\" (UID: \"ce47df57-3777-4fe1-93bd-41323b3fa78a\") "
May 28 18:39:08.103386 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.103245    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdkzf\" (UniqueName: \"kubernetes.io/projected/ce47df57-3777-4fe1-93bd-41323b3fa78a-kube-api-access-kdkzf\") pod \"ce47df57-3777-4fe1-93bd-41323b3fa78a\" (UID: \"ce47df57-3777-4fe1-93bd-41323b3fa78a\") "
May 28 18:39:08.105328 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.105294    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce47df57-3777-4fe1-93bd-41323b3fa78a-kube-api-access-kdkzf" (OuterVolumeSpecName: "kube-api-access-kdkzf") pod "ce47df57-3777-4fe1-93bd-41323b3fa78a" (UID: "ce47df57-3777-4fe1-93bd-41323b3fa78a"). InnerVolumeSpecName "kube-api-access-kdkzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:39:08.113146 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.113122    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce47df57-3777-4fe1-93bd-41323b3fa78a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ce47df57-3777-4fe1-93bd-41323b3fa78a" (UID: "ce47df57-3777-4fe1-93bd-41323b3fa78a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:39:08.203851 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.203821    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce47df57-3777-4fe1-93bd-41323b3fa78a-tls-cert\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:39:08.203851 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.203848    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdkzf\" (UniqueName: \"kubernetes.io/projected/ce47df57-3777-4fe1-93bd-41323b3fa78a-kube-api-access-kdkzf\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:39:08.702338 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.702307    2562 generic.go:358] "Generic (PLEG): container finished" podID="ce47df57-3777-4fe1-93bd-41323b3fa78a" containerID="abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638" exitCode=0
May 28 18:39:08.702773 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.702360    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57c5878fd4-6q9s9"
May 28 18:39:08.702773 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.702398    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c5878fd4-6q9s9" event={"ID":"ce47df57-3777-4fe1-93bd-41323b3fa78a","Type":"ContainerDied","Data":"abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638"}
May 28 18:39:08.702773 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.702440    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57c5878fd4-6q9s9" event={"ID":"ce47df57-3777-4fe1-93bd-41323b3fa78a","Type":"ContainerDied","Data":"c2b73b1df6d0111892052cad52545e6e8ee186bf2cb0387c029c752d6a8c77c1"}
May 28 18:39:08.702773 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.702461    2562 scope.go:117] "RemoveContainer" containerID="abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638"
May 28 18:39:08.713768 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.713748    2562 scope.go:117] "RemoveContainer" containerID="abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638"
May 28 18:39:08.714136 ip-10-0-138-216 kubenswrapper[2562]: E0528 18:39:08.714070    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638\": container with ID starting with abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638 not found: ID does not exist" containerID="abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638"
May 28 18:39:08.714136 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.714111    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638"} err="failed to get container status \"abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638\": rpc error: code = NotFound desc = could not find container \"abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638\": container with ID starting with abdae3271c887545605ec03dfb82fda08218ab05abc112341b03dad18f089638 not found: ID does not exist"
May 28 18:39:08.725274 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.725245    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57c5878fd4-6q9s9"]
May 28 18:39:08.730586 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:08.730564    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57c5878fd4-6q9s9"]
May 28 18:39:10.013237 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:39:10.013210    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce47df57-3777-4fe1-93bd-41323b3fa78a" path="/var/lib/kubelet/pods/ce47df57-3777-4fe1-93bd-41323b3fa78a/volumes"
May 28 18:40:31.380498 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.380462    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dd9d4fb58-qssq9"]
May 28 18:40:31.381023 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.380835    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce47df57-3777-4fe1-93bd-41323b3fa78a" containerName="authorino"
May 28 18:40:31.381023 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.380846    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce47df57-3777-4fe1-93bd-41323b3fa78a" containerName="authorino"
May 28 18:40:31.381023 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.380913    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce47df57-3777-4fe1-93bd-41323b3fa78a" containerName="authorino"
May 28 18:40:31.382836 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.382819    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd9d4fb58-qssq9"
May 28 18:40:31.384735 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.384699    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 18:40:31.384860 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.384699    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-djfgm\""
May 28 18:40:31.392097 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.392070    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dd9d4fb58-qssq9"]
May 28 18:40:31.452433 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.452395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmf8v\" (UniqueName: \"kubernetes.io/projected/4c60faf9-405b-480b-b611-50b2320514d7-kube-api-access-wmf8v\") pod \"maas-controller-7dd9d4fb58-qssq9\" (UID: \"4c60faf9-405b-480b-b611-50b2320514d7\") " pod="opendatahub/maas-controller-7dd9d4fb58-qssq9"
May 28 18:40:31.553717 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.553685    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmf8v\" (UniqueName: \"kubernetes.io/projected/4c60faf9-405b-480b-b611-50b2320514d7-kube-api-access-wmf8v\") pod \"maas-controller-7dd9d4fb58-qssq9\" (UID: \"4c60faf9-405b-480b-b611-50b2320514d7\") " pod="opendatahub/maas-controller-7dd9d4fb58-qssq9"
May 28 18:40:31.561233 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.561201    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmf8v\" (UniqueName: \"kubernetes.io/projected/4c60faf9-405b-480b-b611-50b2320514d7-kube-api-access-wmf8v\") pod \"maas-controller-7dd9d4fb58-qssq9\" (UID: \"4c60faf9-405b-480b-b611-50b2320514d7\") " pod="opendatahub/maas-controller-7dd9d4fb58-qssq9"
May 28 18:40:31.693802 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.693770    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd9d4fb58-qssq9"
May 28 18:40:31.822515 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:31.822486    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dd9d4fb58-qssq9"]
May 28 18:40:31.824995 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:40:31.824969    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c60faf9_405b_480b_b611_50b2320514d7.slice/crio-86e0947c8839789d8bdda04132768f898133a93165219e7411769322d5852d10 WatchSource:0}: Error finding container 86e0947c8839789d8bdda04132768f898133a93165219e7411769322d5852d10: Status 404 returned error can't find the container with id 86e0947c8839789d8bdda04132768f898133a93165219e7411769322d5852d10
May 28 18:40:32.019645 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:32.019562    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd9d4fb58-qssq9" event={"ID":"4c60faf9-405b-480b-b611-50b2320514d7","Type":"ContainerStarted","Data":"86e0947c8839789d8bdda04132768f898133a93165219e7411769322d5852d10"}
May 28 18:40:35.033030 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:35.032994    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd9d4fb58-qssq9" event={"ID":"4c60faf9-405b-480b-b611-50b2320514d7","Type":"ContainerStarted","Data":"fa78a0b220e0f00bcee9e0e464d805fb3945e2f7e44c9eb0e7797ef57efa889f"}
May 28 18:40:35.033508 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:35.033116    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dd9d4fb58-qssq9"
May 28 18:40:35.051196 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:35.051146    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7dd9d4fb58-qssq9" podStartSLOduration=1.7228639540000001 podStartE2EDuration="4.05113224s" podCreationTimestamp="2026-05-28 18:40:31 +0000 UTC" firstStartedPulling="2026-05-28 18:40:31.826191886 +0000 UTC m=+862.415801505" lastFinishedPulling="2026-05-28 18:40:34.154460157 +0000 UTC m=+864.744069791" observedRunningTime="2026-05-28 18:40:35.048935608 +0000 UTC m=+865.638545248" watchObservedRunningTime="2026-05-28 18:40:35.05113224 +0000 UTC m=+865.640741883"
May 28 18:40:46.042882 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:40:46.042849    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dd9d4fb58-qssq9"
May 28 18:41:09.973931 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:41:09.973856    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:41:09.975366 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:41:09.975341    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:41:09.977560 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:41:09.977539    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:41:09.978814 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:41:09.978793    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:45:00.138695 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:00.138649    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666565-z622j"]
May 28 18:45:00.141148 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:00.141128    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666565-z622j"
May 28 18:45:00.143021 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:00.143000    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cmclm\""
May 28 18:45:00.154377 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:00.154347    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666565-z622j"]
May 28 18:45:00.170314 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:00.170285    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2zfh\" (UniqueName: \"kubernetes.io/projected/c8c88dfa-00ca-4135-aadb-82bb964d82c3-kube-api-access-b2zfh\") pod \"maas-api-key-cleanup-29666565-z622j\" (UID: \"c8c88dfa-00ca-4135-aadb-82bb964d82c3\") " pod="opendatahub/maas-api-key-cleanup-29666565-z622j"
May 28 18:45:00.271550 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:00.271506    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2zfh\" (UniqueName: \"kubernetes.io/projected/c8c88dfa-00ca-4135-aadb-82bb964d82c3-kube-api-access-b2zfh\") pod \"maas-api-key-cleanup-29666565-z622j\" (UID: \"c8c88dfa-00ca-4135-aadb-82bb964d82c3\") " pod="opendatahub/maas-api-key-cleanup-29666565-z622j"
May 28 18:45:00.279493 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:00.279456    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2zfh\" (UniqueName: \"kubernetes.io/projected/c8c88dfa-00ca-4135-aadb-82bb964d82c3-kube-api-access-b2zfh\") pod \"maas-api-key-cleanup-29666565-z622j\" (UID: \"c8c88dfa-00ca-4135-aadb-82bb964d82c3\") " pod="opendatahub/maas-api-key-cleanup-29666565-z622j"
May 28 18:45:00.451434 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:00.451399    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666565-z622j"
May 28 18:45:00.587843 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:00.587808    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666565-z622j"]
May 28 18:45:00.593774 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:45:00.593740    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c88dfa_00ca_4135_aadb_82bb964d82c3.slice/crio-4bc6cde9e82f2b1d3b12468f3cf2f2f93af62ee7f754df402fbe7b962afcd3da WatchSource:0}: Error finding container 4bc6cde9e82f2b1d3b12468f3cf2f2f93af62ee7f754df402fbe7b962afcd3da: Status 404 returned error can't find the container with id 4bc6cde9e82f2b1d3b12468f3cf2f2f93af62ee7f754df402fbe7b962afcd3da
May 28 18:45:00.595770 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:00.595752    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:45:01.003656 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:01.003619    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666565-z622j" event={"ID":"c8c88dfa-00ca-4135-aadb-82bb964d82c3","Type":"ContainerStarted","Data":"4bc6cde9e82f2b1d3b12468f3cf2f2f93af62ee7f754df402fbe7b962afcd3da"}
May 28 18:45:04.015501 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:04.015416    2562 generic.go:358] "Generic (PLEG): container finished" podID="c8c88dfa-00ca-4135-aadb-82bb964d82c3" containerID="c2e337f1ba35e57c79a88dc228908f04d5f57035bfe0e0925fd565cc43b58356" exitCode=0
May 28 18:45:04.015501 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:04.015458    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666565-z622j" event={"ID":"c8c88dfa-00ca-4135-aadb-82bb964d82c3","Type":"ContainerDied","Data":"c2e337f1ba35e57c79a88dc228908f04d5f57035bfe0e0925fd565cc43b58356"}
May 28 18:45:05.156776 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:05.156742    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666565-z622j"
May 28 18:45:05.228543 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:05.228506    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2zfh\" (UniqueName: \"kubernetes.io/projected/c8c88dfa-00ca-4135-aadb-82bb964d82c3-kube-api-access-b2zfh\") pod \"c8c88dfa-00ca-4135-aadb-82bb964d82c3\" (UID: \"c8c88dfa-00ca-4135-aadb-82bb964d82c3\") "
May 28 18:45:05.230765 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:05.230710    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8c88dfa-00ca-4135-aadb-82bb964d82c3-kube-api-access-b2zfh" (OuterVolumeSpecName: "kube-api-access-b2zfh") pod "c8c88dfa-00ca-4135-aadb-82bb964d82c3" (UID: "c8c88dfa-00ca-4135-aadb-82bb964d82c3"). InnerVolumeSpecName "kube-api-access-b2zfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:45:05.329571 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:05.329470    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2zfh\" (UniqueName: \"kubernetes.io/projected/c8c88dfa-00ca-4135-aadb-82bb964d82c3-kube-api-access-b2zfh\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:45:06.023233 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:06.023199    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666565-z622j" event={"ID":"c8c88dfa-00ca-4135-aadb-82bb964d82c3","Type":"ContainerDied","Data":"4bc6cde9e82f2b1d3b12468f3cf2f2f93af62ee7f754df402fbe7b962afcd3da"}
May 28 18:45:06.023233 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:06.023220    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666565-z622j"
May 28 18:45:06.023233 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:45:06.023234    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bc6cde9e82f2b1d3b12468f3cf2f2f93af62ee7f754df402fbe7b962afcd3da"
May 28 18:46:09.998934 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:46:09.998904    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:46:10.001664 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:46:10.001643    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:46:10.002676 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:46:10.002650    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:46:10.005010 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:46:10.004992    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:50:49.264519 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:49.264473    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"]
May 28 18:50:49.265048 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:49.264747    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz" podUID="22d75438-bb34-4a49-af37-7b300e012b18" containerName="manager" containerID="cri-o://5fc69065b5928054c5f2c68b0095be86c04319d0f84214763886840c5c5386d9" gracePeriod=10
May 28 18:50:50.213882 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:50.213855    2562 generic.go:358] "Generic (PLEG): container finished" podID="22d75438-bb34-4a49-af37-7b300e012b18" containerID="5fc69065b5928054c5f2c68b0095be86c04319d0f84214763886840c5c5386d9" exitCode=0
May 28 18:50:50.214038 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:50.213891    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz" event={"ID":"22d75438-bb34-4a49-af37-7b300e012b18","Type":"ContainerDied","Data":"5fc69065b5928054c5f2c68b0095be86c04319d0f84214763886840c5c5386d9"}
May 28 18:50:50.410052 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:50.410031    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:50:50.587360 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:50.587279    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qk9xs\" (UniqueName: \"kubernetes.io/projected/22d75438-bb34-4a49-af37-7b300e012b18-kube-api-access-qk9xs\") pod \"22d75438-bb34-4a49-af37-7b300e012b18\" (UID: \"22d75438-bb34-4a49-af37-7b300e012b18\") "
May 28 18:50:50.587493 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:50.587362    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d75438-bb34-4a49-af37-7b300e012b18-extensions-socket-volume\") pod \"22d75438-bb34-4a49-af37-7b300e012b18\" (UID: \"22d75438-bb34-4a49-af37-7b300e012b18\") "
May 28 18:50:50.587797 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:50.587774    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22d75438-bb34-4a49-af37-7b300e012b18-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "22d75438-bb34-4a49-af37-7b300e012b18" (UID: "22d75438-bb34-4a49-af37-7b300e012b18"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:50:50.589388 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:50.589365    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22d75438-bb34-4a49-af37-7b300e012b18-kube-api-access-qk9xs" (OuterVolumeSpecName: "kube-api-access-qk9xs") pod "22d75438-bb34-4a49-af37-7b300e012b18" (UID: "22d75438-bb34-4a49-af37-7b300e012b18"). InnerVolumeSpecName "kube-api-access-qk9xs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:50:50.687915 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:50.687889    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk9xs\" (UniqueName: \"kubernetes.io/projected/22d75438-bb34-4a49-af37-7b300e012b18-kube-api-access-qk9xs\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:50:50.687915 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:50.687913    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22d75438-bb34-4a49-af37-7b300e012b18-extensions-socket-volume\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 18:50:51.218672 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:51.218638    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz" event={"ID":"22d75438-bb34-4a49-af37-7b300e012b18","Type":"ContainerDied","Data":"3667329f6829c0b39e9eb6e05ef7a7b16a1421bd70328995c34f592b5d9e8d43"}
May 28 18:50:51.218891 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:51.218681    2562 scope.go:117] "RemoveContainer" containerID="5fc69065b5928054c5f2c68b0095be86c04319d0f84214763886840c5c5386d9"
May 28 18:50:51.218891 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:51.218683    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"
May 28 18:50:51.240669 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:51.240645    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"]
May 28 18:50:51.245598 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:51.245565    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9g8xz"]
May 28 18:50:52.012075 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:50:52.012045    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22d75438-bb34-4a49-af37-7b300e012b18" path="/var/lib/kubelet/pods/22d75438-bb34-4a49-af37-7b300e012b18/volumes"
May 28 18:51:10.023629 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:10.023600    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:51:10.027067 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:10.027042    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:51:10.027775 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:10.027759    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:51:10.030952 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:10.030935    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:51:55.444397 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.444362    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"]
May 28 18:51:55.444832 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.444710    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8c88dfa-00ca-4135-aadb-82bb964d82c3" containerName="cleanup"
May 28 18:51:55.444832 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.444737    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8c88dfa-00ca-4135-aadb-82bb964d82c3" containerName="cleanup"
May 28 18:51:55.444832 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.444757    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22d75438-bb34-4a49-af37-7b300e012b18" containerName="manager"
May 28 18:51:55.444832 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.444762    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="22d75438-bb34-4a49-af37-7b300e012b18" containerName="manager"
May 28 18:51:55.444832 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.444826    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="22d75438-bb34-4a49-af37-7b300e012b18" containerName="manager"
May 28 18:51:55.444996 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.444839    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="c8c88dfa-00ca-4135-aadb-82bb964d82c3" containerName="cleanup"
May 28 18:51:55.447664 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.447643    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"
May 28 18:51:55.455351 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.455335    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2vbj5\""
May 28 18:51:55.469897 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.469875    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"]
May 28 18:51:55.547027 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.547002    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d311252-202f-4870-87b2-fd213fff5da4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kjxr8\" (UID: \"3d311252-202f-4870-87b2-fd213fff5da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"
May 28 18:51:55.547159 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.547047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zv2s\" (UniqueName: \"kubernetes.io/projected/3d311252-202f-4870-87b2-fd213fff5da4-kube-api-access-2zv2s\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kjxr8\" (UID: \"3d311252-202f-4870-87b2-fd213fff5da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"
May 28 18:51:55.647790 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.647757    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d311252-202f-4870-87b2-fd213fff5da4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kjxr8\" (UID: \"3d311252-202f-4870-87b2-fd213fff5da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"
May 28 18:51:55.647935 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.647825    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zv2s\" (UniqueName: \"kubernetes.io/projected/3d311252-202f-4870-87b2-fd213fff5da4-kube-api-access-2zv2s\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kjxr8\" (UID: \"3d311252-202f-4870-87b2-fd213fff5da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"
May 28 18:51:55.648125 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.648106    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d311252-202f-4870-87b2-fd213fff5da4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kjxr8\" (UID: \"3d311252-202f-4870-87b2-fd213fff5da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"
May 28 18:51:55.658022 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.657999    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zv2s\" (UniqueName: \"kubernetes.io/projected/3d311252-202f-4870-87b2-fd213fff5da4-kube-api-access-2zv2s\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kjxr8\" (UID: \"3d311252-202f-4870-87b2-fd213fff5da4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"
May 28 18:51:55.757632 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.757554    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"
May 28 18:51:55.902669 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.902644    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"]
May 28 18:51:55.904892 ip-10-0-138-216 kubenswrapper[2562]: W0528 18:51:55.904864    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d311252_202f_4870_87b2_fd213fff5da4.slice/crio-116aa6dee41bee62367aab049aaf2dfd9e116db0314b1cbf2c055274b0048526 WatchSource:0}: Error finding container 116aa6dee41bee62367aab049aaf2dfd9e116db0314b1cbf2c055274b0048526: Status 404 returned error can't find the container with id 116aa6dee41bee62367aab049aaf2dfd9e116db0314b1cbf2c055274b0048526
May 28 18:51:55.907201 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:55.907183    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:51:56.445859 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:56.445815    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8" event={"ID":"3d311252-202f-4870-87b2-fd213fff5da4","Type":"ContainerStarted","Data":"edb4e615f222e71b5fe0cf6bfc19bb2aab9488946ed98b3d020e8444581a03cd"}
May 28 18:51:56.446304 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:56.445868    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8" event={"ID":"3d311252-202f-4870-87b2-fd213fff5da4","Type":"ContainerStarted","Data":"116aa6dee41bee62367aab049aaf2dfd9e116db0314b1cbf2c055274b0048526"}
May 28 18:51:56.446304 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:56.445904    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"
May 28 18:51:56.497060 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:51:56.497008    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8" podStartSLOduration=1.496993288 podStartE2EDuration="1.496993288s" podCreationTimestamp="2026-05-28 18:51:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:51:56.494217368 +0000 UTC m=+1547.083827021" watchObservedRunningTime="2026-05-28 18:51:56.496993288 +0000 UTC m=+1547.086602928"
May 28 18:52:07.451699 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:52:07.451663    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kjxr8"
May 28 18:56:10.049288 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:56:10.049257    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:56:10.052557 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:56:10.052532    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 18:56:10.057087 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:56:10.057069    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 18:56:10.060542 ip-10-0-138-216 kubenswrapper[2562]: I0528 18:56:10.060520    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 19:00:00.137110 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:00.137069    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666580-t48hh"]
May 28 19:00:00.140480 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:00.140463    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-t48hh"
May 28 19:00:00.142510 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:00.142485    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cmclm\""
May 28 19:00:00.153554 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:00.153525    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666580-t48hh"]
May 28 19:00:00.200386 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:00.200351    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9csk\" (UniqueName: \"kubernetes.io/projected/3ab249d9-0124-4042-9df4-358ce4c0583a-kube-api-access-j9csk\") pod \"maas-api-key-cleanup-29666580-t48hh\" (UID: \"3ab249d9-0124-4042-9df4-358ce4c0583a\") " pod="opendatahub/maas-api-key-cleanup-29666580-t48hh"
May 28 19:00:00.301782 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:00.301703    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9csk\" (UniqueName: \"kubernetes.io/projected/3ab249d9-0124-4042-9df4-358ce4c0583a-kube-api-access-j9csk\") pod \"maas-api-key-cleanup-29666580-t48hh\" (UID: \"3ab249d9-0124-4042-9df4-358ce4c0583a\") " pod="opendatahub/maas-api-key-cleanup-29666580-t48hh"
May 28 19:00:00.309984 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:00.309948    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9csk\" (UniqueName: \"kubernetes.io/projected/3ab249d9-0124-4042-9df4-358ce4c0583a-kube-api-access-j9csk\") pod \"maas-api-key-cleanup-29666580-t48hh\" (UID: \"3ab249d9-0124-4042-9df4-358ce4c0583a\") " pod="opendatahub/maas-api-key-cleanup-29666580-t48hh"
May 28 19:00:00.450574 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:00.450547    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-t48hh"
May 28 19:00:00.590537 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:00.590510    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666580-t48hh"]
May 28 19:00:00.593705 ip-10-0-138-216 kubenswrapper[2562]: W0528 19:00:00.593677    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab249d9_0124_4042_9df4_358ce4c0583a.slice/crio-12f1731be01f260bc3e5ba924e722b9d60710595c316223bff04a9e6122f4b4f WatchSource:0}: Error finding container 12f1731be01f260bc3e5ba924e722b9d60710595c316223bff04a9e6122f4b4f: Status 404 returned error can't find the container with id 12f1731be01f260bc3e5ba924e722b9d60710595c316223bff04a9e6122f4b4f
May 28 19:00:00.595943 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:00.595926    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 19:00:01.172056 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:01.171966    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666580-t48hh" event={"ID":"3ab249d9-0124-4042-9df4-358ce4c0583a","Type":"ContainerStarted","Data":"59c47a3b7c814cb705864c906967c84b9a9ec76dd34951ec518b4d0e84820729"}
May 28 19:00:01.172056 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:01.172002    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666580-t48hh" event={"ID":"3ab249d9-0124-4042-9df4-358ce4c0583a","Type":"ContainerStarted","Data":"12f1731be01f260bc3e5ba924e722b9d60710595c316223bff04a9e6122f4b4f"}
May 28 19:00:01.189386 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:01.189338    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29666580-t48hh" podStartSLOduration=1.189324901 podStartE2EDuration="1.189324901s" podCreationTimestamp="2026-05-28 19:00:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:00:01.186755947 +0000 UTC m=+2031.776365586" watchObservedRunningTime="2026-05-28 19:00:01.189324901 +0000 UTC m=+2031.778934580"
May 28 19:00:02.176428 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:02.176395    2562 generic.go:358] "Generic (PLEG): container finished" podID="3ab249d9-0124-4042-9df4-358ce4c0583a" containerID="59c47a3b7c814cb705864c906967c84b9a9ec76dd34951ec518b4d0e84820729" exitCode=0
May 28 19:00:02.176855 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:02.176461    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666580-t48hh" event={"ID":"3ab249d9-0124-4042-9df4-358ce4c0583a","Type":"ContainerDied","Data":"59c47a3b7c814cb705864c906967c84b9a9ec76dd34951ec518b4d0e84820729"}
May 28 19:00:03.312820 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:03.312797    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-t48hh"
May 28 19:00:03.435380 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:03.435295    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9csk\" (UniqueName: \"kubernetes.io/projected/3ab249d9-0124-4042-9df4-358ce4c0583a-kube-api-access-j9csk\") pod \"3ab249d9-0124-4042-9df4-358ce4c0583a\" (UID: \"3ab249d9-0124-4042-9df4-358ce4c0583a\") "
May 28 19:00:03.437411 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:03.437379    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ab249d9-0124-4042-9df4-358ce4c0583a-kube-api-access-j9csk" (OuterVolumeSpecName: "kube-api-access-j9csk") pod "3ab249d9-0124-4042-9df4-358ce4c0583a" (UID: "3ab249d9-0124-4042-9df4-358ce4c0583a"). InnerVolumeSpecName "kube-api-access-j9csk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:00:03.536120 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:03.536085    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9csk\" (UniqueName: \"kubernetes.io/projected/3ab249d9-0124-4042-9df4-358ce4c0583a-kube-api-access-j9csk\") on node \"ip-10-0-138-216.ec2.internal\" DevicePath \"\""
May 28 19:00:04.184509 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:04.184480    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666580-t48hh"
May 28 19:00:04.184671 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:04.184475    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666580-t48hh" event={"ID":"3ab249d9-0124-4042-9df4-358ce4c0583a","Type":"ContainerDied","Data":"12f1731be01f260bc3e5ba924e722b9d60710595c316223bff04a9e6122f4b4f"}
May 28 19:00:04.184671 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:00:04.184590    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12f1731be01f260bc3e5ba924e722b9d60710595c316223bff04a9e6122f4b4f"
May 28 19:01:10.074199 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:10.074165    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 19:01:10.077349 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:10.077324    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 19:01:10.083707 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:10.083689    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 19:01:10.086970 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:10.086955    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 19:01:37.086543 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:37.086511    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86d5545665-bsjk6_ac283ac2-94ee-45f6-ae6c-f6535017ca3e/authorino/0.log"
May 28 19:01:41.727679 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:41.727647    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666565-z622j_c8c88dfa-00ca-4135-aadb-82bb964d82c3/cleanup/0.log"
May 28 19:01:41.832359 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:41.832330    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666580-t48hh_3ab249d9-0124-4042-9df4-358ce4c0583a/cleanup/0.log"
May 28 19:01:41.950531 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:41.950491    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7dd9d4fb58-qssq9_4c60faf9-405b-480b-b611-50b2320514d7/manager/0.log"
May 28 19:01:42.173620 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:42.173536    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b658c4654-b2v6f_82a367ab-e879-46d4-b6bd-fd861a8d3490/manager/0.log"
May 28 19:01:43.759406 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:43.759365    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86d5545665-bsjk6_ac283ac2-94ee-45f6-ae6c-f6535017ca3e/authorino/0.log"
May 28 19:01:43.980873 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:43.980842    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-k24j7_289254f3-46ea-4d2d-ad5e-5aa2dd72d677/manager/0.log"
May 28 19:01:44.333020 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:44.332993    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-kjxr8_3d311252-202f-4870-87b2-fd213fff5da4/manager/0.log"
May 28 19:01:44.579120 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:44.579086    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-fnt4p_62f4eadf-e968-4d86-9a5f-e3f87c5b2830/manager/0.log"
May 28 19:01:44.915916 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:44.915882    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd_2ccccddd-e3ce-4160-8ea5-5641f19fcb52/istio-proxy/0.log"
May 28 19:01:45.375417 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:45.375387    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-9qtxc_4e19a3bc-72cb-477c-8d80-9070941902dd/istio-proxy/0.log"
May 28 19:01:45.614235 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:45.614195    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7ccdf994fb-rbxch_67135a28-9521-483e-ac94-3afffb5e478f/router/0.log"
May 28 19:01:54.123222 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:54.123187    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4xtns_f6f8994e-61a4-470b-874e-11d108500743/global-pull-secret-syncer/0.log"
May 28 19:01:54.400954 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:54.400859    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jzfzd_4c85ab10-3394-4dc4-a3e4-7419efb552bf/konnectivity-agent/0.log"
May 28 19:01:54.456418 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:54.456383    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-216.ec2.internal_ac25bcb2d036809e2b2845a0da4269f7/haproxy/0.log"
May 28 19:01:58.798684 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:58.798648    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86d5545665-bsjk6_ac283ac2-94ee-45f6-ae6c-f6535017ca3e/authorino/0.log"
May 28 19:01:58.848967 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:58.848933    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-k24j7_289254f3-46ea-4d2d-ad5e-5aa2dd72d677/manager/0.log"
May 28 19:01:59.018023 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:59.017988    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-kjxr8_3d311252-202f-4870-87b2-fd213fff5da4/manager/0.log"
May 28 19:01:59.153129 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:01:59.153105    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-fnt4p_62f4eadf-e968-4d86-9a5f-e3f87c5b2830/manager/0.log"
May 28 19:02:00.718077 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:00.718037    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-6bcbt_ad16d484-f1e3-4e9b-89a0-da6c330f9599/cluster-monitoring-operator/0.log"
May 28 19:02:00.748099 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:00.748070    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qnsnd_3710f8f8-bb68-48b8-a843-6533f66610bd/kube-state-metrics/0.log"
May 28 19:02:00.763873 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:00.763845    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qnsnd_3710f8f8-bb68-48b8-a843-6533f66610bd/kube-rbac-proxy-main/0.log"
May 28 19:02:00.785648 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:00.785630    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-qnsnd_3710f8f8-bb68-48b8-a843-6533f66610bd/kube-rbac-proxy-self/0.log"
May 28 19:02:00.814332 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:00.814308    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-fd9988574-6j2md_c9dac9a2-b3ee-4a4b-ab18-8c07eefe7c2d/metrics-server/0.log"
May 28 19:02:00.956134 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:00.956058    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bk7f7_b2dcc3c4-a954-40b8-864c-4dfd1db90f27/node-exporter/0.log"
May 28 19:02:00.974713 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:00.974685    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bk7f7_b2dcc3c4-a954-40b8-864c-4dfd1db90f27/kube-rbac-proxy/0.log"
May 28 19:02:00.995582 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:00.995564    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bk7f7_b2dcc3c4-a954-40b8-864c-4dfd1db90f27/init-textfile/0.log"
May 28 19:02:01.182508 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:01.182481    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b81204b5-a4dd-45ae-8f9e-4682c992cf0c/prometheus/0.log"
May 28 19:02:01.210487 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:01.210412    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b81204b5-a4dd-45ae-8f9e-4682c992cf0c/config-reloader/0.log"
May 28 19:02:01.230956 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:01.230930    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b81204b5-a4dd-45ae-8f9e-4682c992cf0c/thanos-sidecar/0.log"
May 28 19:02:01.251375 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:01.251344    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b81204b5-a4dd-45ae-8f9e-4682c992cf0c/kube-rbac-proxy-web/0.log"
May 28 19:02:01.273799 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:01.273768    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b81204b5-a4dd-45ae-8f9e-4682c992cf0c/kube-rbac-proxy/0.log"
May 28 19:02:01.294248 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:01.294230    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b81204b5-a4dd-45ae-8f9e-4682c992cf0c/kube-rbac-proxy-thanos/0.log"
May 28 19:02:01.322936 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:01.322905    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b81204b5-a4dd-45ae-8f9e-4682c992cf0c/init-config-reloader/0.log"
May 28 19:02:01.353548 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:01.353527    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-zhkdn_4029e8cc-af77-4af5-9e3f-7a4122c81f50/prometheus-operator/0.log"
May 28 19:02:01.371498 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:01.371472    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-zhkdn_4029e8cc-af77-4af5-9e3f-7a4122c81f50/kube-rbac-proxy/0.log"
May 28 19:02:02.803270 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.803235    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"]
May 28 19:02:02.803821 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.803735    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ab249d9-0124-4042-9df4-358ce4c0583a" containerName="cleanup"
May 28 19:02:02.803821 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.803756    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ab249d9-0124-4042-9df4-358ce4c0583a" containerName="cleanup"
May 28 19:02:02.803952 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.803871    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="3ab249d9-0124-4042-9df4-358ce4c0583a" containerName="cleanup"
May 28 19:02:02.809655 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.809637    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:02.812106 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.812085    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8pbq\"/\"openshift-service-ca.crt\""
May 28 19:02:02.812197 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.812118    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g8pbq\"/\"default-dockercfg-9kfz9\""
May 28 19:02:02.812742 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.812708    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8pbq\"/\"kube-root-ca.crt\""
May 28 19:02:02.815623 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.815602    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"]
May 28 19:02:02.923428 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.923394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-lib-modules\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:02.923428 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.923432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-proc\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:02.923634 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.923536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxs99\" (UniqueName: \"kubernetes.io/projected/76e706f3-387d-4303-aa15-550580467e00-kube-api-access-xxs99\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:02.923634 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.923598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-podres\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:02.923634 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:02.923628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-sys\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.024674 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.024639    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-sys\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.024674 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.024677    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-lib-modules\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.024886 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.024698    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-proc\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.024886 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.024754    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xxs99\" (UniqueName: \"kubernetes.io/projected/76e706f3-387d-4303-aa15-550580467e00-kube-api-access-xxs99\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.024886 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.024789    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-sys\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.024886 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.024802    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-podres\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.024886 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.024853    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-lib-modules\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.024886 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.024867    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-proc\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.025082 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.024921    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76e706f3-387d-4303-aa15-550580467e00-podres\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.032702 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.032673    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxs99\" (UniqueName: \"kubernetes.io/projected/76e706f3-387d-4303-aa15-550580467e00-kube-api-access-xxs99\") pod \"perf-node-gather-daemonset-gtcwf\" (UID: \"76e706f3-387d-4303-aa15-550580467e00\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.120967 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.120890    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.189401 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.189368    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/2.log"
May 28 19:02:03.197777 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.197748    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-fbgk7_94c9365b-36fc-49e8-b3d2-71b861c649ec/console-operator/3.log"
May 28 19:02:03.252517 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.252464    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"]
May 28 19:02:03.255159 ip-10-0-138-216 kubenswrapper[2562]: W0528 19:02:03.255134    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod76e706f3_387d_4303_aa15_550580467e00.slice/crio-e2dd0f320c7d8f8fd0c5a30362a24874cf38f864405ee2d7de249caa4fbb9e8e WatchSource:0}: Error finding container e2dd0f320c7d8f8fd0c5a30362a24874cf38f864405ee2d7de249caa4fbb9e8e: Status 404 returned error can't find the container with id e2dd0f320c7d8f8fd0c5a30362a24874cf38f864405ee2d7de249caa4fbb9e8e
May 28 19:02:03.620901 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.620859    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf" event={"ID":"76e706f3-387d-4303-aa15-550580467e00","Type":"ContainerStarted","Data":"a8a1a0ee3311c4c87e0c125507f29d091623856041ed4d298b4b8d5e51939493"}
May 28 19:02:03.620901 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.620904    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf" event={"ID":"76e706f3-387d-4303-aa15-550580467e00","Type":"ContainerStarted","Data":"e2dd0f320c7d8f8fd0c5a30362a24874cf38f864405ee2d7de249caa4fbb9e8e"}
May 28 19:02:03.621155 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.620953    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:03.636640 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:03.636552    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf" podStartSLOduration=1.6365381509999999 podStartE2EDuration="1.636538151s" podCreationTimestamp="2026-05-28 19:02:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:02:03.635818447 +0000 UTC m=+2154.225428087" watchObservedRunningTime="2026-05-28 19:02:03.636538151 +0000 UTC m=+2154.226147793"
May 28 19:02:04.255695 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:04.255648    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-k44pz_f033b0a7-f835-4a7c-a0ef-ba47ea93942d/volume-data-source-validator/0.log"
May 28 19:02:05.043099 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:05.043068    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ccp2w_e7c82257-ba41-41c3-abf9-d912f400b80a/dns/0.log"
May 28 19:02:05.063273 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:05.063245    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ccp2w_e7c82257-ba41-41c3-abf9-d912f400b80a/kube-rbac-proxy/0.log"
May 28 19:02:05.173731 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:05.173695    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d528j_8e845702-c1e8-4dec-907a-773ed9ab8137/dns-node-resolver/0.log"
May 28 19:02:05.669910 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:05.669873    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2dmsn_3ac7180b-8d0f-4c78-ad91-ec4104359bcc/node-ca/0.log"
May 28 19:02:06.515952 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:06.515920    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bs8bgd_2ccccddd-e3ce-4160-8ea5-5641f19fcb52/istio-proxy/0.log"
May 28 19:02:06.842207 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:06.842121    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-9qtxc_4e19a3bc-72cb-477c-8d80-9070941902dd/istio-proxy/0.log"
May 28 19:02:06.957407 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:06.957372    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7ccdf994fb-rbxch_67135a28-9521-483e-ac94-3afffb5e478f/router/0.log"
May 28 19:02:07.527563 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:07.527531    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vdvxl_2f5e88e3-dd35-45b5-a7ea-4b387a9bc610/serve-healthcheck-canary/0.log"
May 28 19:02:07.957064 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:07.957029    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-lzjbq_67fa7b8d-2757-4384-bf17-9f9b50060d25/insights-operator/0.log"
May 28 19:02:07.957928 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:07.957906    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-lzjbq_67fa7b8d-2757-4384-bf17-9f9b50060d25/insights-operator/1.log"
May 28 19:02:08.115494 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:08.115467    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npm74_2e4f5d47-c878-4f30-9531-19fc51e114ee/kube-rbac-proxy/0.log"
May 28 19:02:08.136175 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:08.136150    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npm74_2e4f5d47-c878-4f30-9531-19fc51e114ee/exporter/0.log"
May 28 19:02:08.159279 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:08.159250    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npm74_2e4f5d47-c878-4f30-9531-19fc51e114ee/extractor/0.log"
May 28 19:02:09.635210 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:09.635183    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-gtcwf"
May 28 19:02:10.142516 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:10.142491    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666565-z622j_c8c88dfa-00ca-4135-aadb-82bb964d82c3/cleanup/0.log"
May 28 19:02:10.164491 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:10.164462    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666580-t48hh_3ab249d9-0124-4042-9df4-358ce4c0583a/cleanup/0.log"
May 28 19:02:10.273951 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:10.273913    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7dd9d4fb58-qssq9_4c60faf9-405b-480b-b611-50b2320514d7/manager/0.log"
May 28 19:02:10.342281 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:10.342248    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b658c4654-b2v6f_82a367ab-e879-46d4-b6bd-fd861a8d3490/manager/0.log"
May 28 19:02:11.672221 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:11.672186    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85db54859f-vjmd2_19908dd7-2bf9-4d2b-9e0d-eddf0b07e9d2/manager/0.log"
May 28 19:02:16.242113 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:16.242082    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-ldxnw_e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae/kube-storage-version-migrator-operator/1.log"
May 28 19:02:16.243937 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:16.243909    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-ldxnw_e7f23dbf-c706-4dca-a5fd-89e5f9cf2fae/kube-storage-version-migrator-operator/0.log"
May 28 19:02:17.487277 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:17.487248    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4ghf_f7239413-938b-42bb-bad9-d4e42c0e0599/kube-multus-additional-cni-plugins/0.log"
May 28 19:02:17.509597 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:17.509562    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4ghf_f7239413-938b-42bb-bad9-d4e42c0e0599/egress-router-binary-copy/0.log"
May 28 19:02:17.530226 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:17.530202    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4ghf_f7239413-938b-42bb-bad9-d4e42c0e0599/cni-plugins/0.log"
May 28 19:02:17.550126 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:17.550102    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4ghf_f7239413-938b-42bb-bad9-d4e42c0e0599/bond-cni-plugin/0.log"
May 28 19:02:17.569122 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:17.569101    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4ghf_f7239413-938b-42bb-bad9-d4e42c0e0599/routeoverride-cni/0.log"
May 28 19:02:17.588010 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:17.587989    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4ghf_f7239413-938b-42bb-bad9-d4e42c0e0599/whereabouts-cni-bincopy/0.log"
May 28 19:02:17.607013 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:17.606991    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4ghf_f7239413-938b-42bb-bad9-d4e42c0e0599/whereabouts-cni/0.log"
May 28 19:02:17.696654 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:17.696623    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n5lrf_2ad0402a-5df5-43f0-bb52-3a5a93cf47f1/kube-multus/0.log"
May 28 19:02:17.717382 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:17.717353    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2jrmq_26b71d0c-8000-421e-b031-4805782b9c85/network-metrics-daemon/0.log"
May 28 19:02:17.733197 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:17.733173    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2jrmq_26b71d0c-8000-421e-b031-4805782b9c85/kube-rbac-proxy/0.log"
May 28 19:02:19.267556 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:19.267525    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-controller/0.log"
May 28 19:02:19.289893 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:19.289860    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/0.log"
May 28 19:02:19.311864 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:19.311838    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovn-acl-logging/1.log"
May 28 19:02:19.333498 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:19.333474    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/kube-rbac-proxy-node/0.log"
May 28 19:02:19.356038 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:19.356003    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/kube-rbac-proxy-ovn-metrics/0.log"
May 28 19:02:19.376946 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:19.376927    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/northd/0.log"
May 28 19:02:19.399127 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:19.399103    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/nbdb/0.log"
May 28 19:02:19.421036 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:19.421013    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/sbdb/0.log"
May 28 19:02:19.594466 ip-10-0-138-216 kubenswrapper[2562]: I0528 19:02:19.594347    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x67nm_13d06b62-8ab7-4492-b886-386083b47d5f/ovnkube-controller/0.log"