May 20 20:19:53.422492 ip-10-0-138-220 systemd[1]: Starting Kubernetes Kubelet...
May 20 20:19:53.907037 ip-10-0-138-220 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:19:53.907037 ip-10-0-138-220 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 20 20:19:53.907037 ip-10-0-138-220 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:19:53.907037 ip-10-0-138-220 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 20 20:19:53.907037 ip-10-0-138-220 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 20:19:53.908948 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.908802    2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 20 20:19:53.915057 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915036    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:19:53.915057 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915056    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:19:53.915057 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915059    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915062    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915066    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915069    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915073    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915075    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915078    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915081    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915083    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915086    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915094    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915097    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915100    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915103    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915105    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915109    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915111    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915114    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915117    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:19:53.915157 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915119    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915121    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915124    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915127    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915129    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915132    2575 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915134    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915137    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915139    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915141    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915144    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915146    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915149    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915157    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915160    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915163    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915165    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915168    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915171    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915173    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:19:53.915618 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915178    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915182    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915185    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915187    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915202    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915205    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915208    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915211    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915213    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915217    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915220    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915223    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915226    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915229    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915233    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915236    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915239    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915242    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915245    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915247    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:19:53.916116 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915250    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915252    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915255    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915259    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915262    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915266    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915269    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915272    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915275    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915277    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915280    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915282    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915284    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915287    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915289    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915292    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915294    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915297    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915299    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:19:53.916658 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915302    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915304    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915307    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915309    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915312    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915314    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915735    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915741    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915745    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915748    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915751    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915755    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915758    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915761    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915764    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915766    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915769    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915772    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915775    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:19:53.917114 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915777    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915781    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915784    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915787    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915790    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915794    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915796    2575 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915799    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915802    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915805    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915807    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915809    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915812    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915815    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915817    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915820    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915822    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915825    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915827    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915830    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:19:53.917601 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915834    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915836    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915839    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915842    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915844    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915847    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915851    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915854    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915856    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915859    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915861    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915864    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915866    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915869    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915872    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915874    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915877    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915879    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915882    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:19:53.918088 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915884    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915887    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915889    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915892    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915895    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915897    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915900    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915907    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915910    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915912    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915915    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915917    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915919    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915923    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915925    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915928    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915931    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915934    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915936    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915939    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:19:53.918550 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915941    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915944    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915946    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915949    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915951    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915954    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915957    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915959    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915962    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915964    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915967    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915969    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915972    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.915974    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916054    2575 flags.go:64] FLAG: --address="0.0.0.0"
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916066    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916091    2575 flags.go:64] FLAG: --anonymous-auth="true"
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916096    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916100    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916104    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916108    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 20 20:19:53.919106 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916113    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916117    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916120    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916124    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916128    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916132    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916134    2575 flags.go:64] FLAG: --cgroup-root=""
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916138    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916140    2575 flags.go:64] FLAG: --client-ca-file=""
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916143    2575 flags.go:64] FLAG: --cloud-config=""
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916146    2575 flags.go:64] FLAG: --cloud-provider="external"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916149    2575 flags.go:64] FLAG: --cluster-dns="[]"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916153    2575 flags.go:64] FLAG: --cluster-domain=""
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916156    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916160    2575 flags.go:64] FLAG: --config-dir=""
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916163    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916167    2575 flags.go:64] FLAG: --container-log-max-files="5"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916171    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916176    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916179    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916182    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916185    2575 flags.go:64] FLAG: --contention-profiling="false"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916200    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916204    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916207    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
May 20 20:19:53.919631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916210    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916214    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916217    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916220    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916223    2575 flags.go:64] FLAG: --enable-load-reader="false"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916225    2575 flags.go:64] FLAG: --enable-server="true"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916228    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916233    2575 flags.go:64] FLAG: --event-burst="100"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916237    2575 flags.go:64] FLAG: --event-qps="50"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916239    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916243    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916246    2575 flags.go:64] FLAG: --eviction-hard=""
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916251    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916254    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916257    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916260    2575 flags.go:64] FLAG: --eviction-soft=""
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916263    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916266    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916269    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916272    2575 flags.go:64] FLAG: --experimental-mounter-path=""
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916275    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916278    2575 flags.go:64] FLAG: --fail-swap-on="true"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916281    2575 flags.go:64] FLAG: --feature-gates=""
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916285    2575 flags.go:64] FLAG: --file-check-frequency="20s"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916288    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 20 20:19:53.920268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916291    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916295    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916298    2575 flags.go:64] FLAG: --healthz-port="10248"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916301    2575 flags.go:64] FLAG: --help="false"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916304    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-138-220.ec2.internal"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916307    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916310    2575 flags.go:64] FLAG: --http-check-frequency="20s"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916313    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916317    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916320    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916323    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916326    2575 flags.go:64] FLAG: --image-service-endpoint=""
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916329    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916332    2575 flags.go:64] FLAG: --kube-api-burst="100"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916334    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916338    2575 flags.go:64] FLAG: --kube-api-qps="50"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916341    2575 flags.go:64] FLAG: --kube-reserved=""
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916344    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916347    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916351    2575 flags.go:64] FLAG: --kubelet-cgroups=""
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916354    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916357    2575 flags.go:64] FLAG: --lock-file=""
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916360    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916363    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
May 20 20:19:53.920874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916366    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916372    2575 flags.go:64] FLAG: --log-json-split-stream="false"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916375    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916378    2575 flags.go:64] FLAG: --log-text-split-stream="false"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916381    2575 flags.go:64] FLAG: --logging-format="text"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916384    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916388    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916391    2575 flags.go:64] FLAG: --manifest-url=""
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916394    2575 flags.go:64] FLAG: --manifest-url-header=""
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916398    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916401    2575 flags.go:64] FLAG: --max-open-files="1000000"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916406    2575 flags.go:64] FLAG: --max-pods="110"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916409    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916412    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916415    2575 flags.go:64] FLAG: --memory-manager-policy="None"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916417    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916420    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916423    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916426    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916434    2575 flags.go:64] FLAG: --node-status-max-images="50"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916438    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916441    2575 flags.go:64] FLAG: --oom-score-adj="-999"
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916444    2575 flags.go:64] FLAG: --pod-cidr=""
May 20 20:19:53.921523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916447    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916453    2575 flags.go:64] FLAG: --pod-manifest-path=""
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916456    2575 flags.go:64] FLAG: --pod-max-pids="-1"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916460    2575 flags.go:64] FLAG: --pods-per-core="0"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916463    2575 flags.go:64] FLAG: --port="10250"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916466    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916469    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09ad87559af9c2bbf"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916472    2575 flags.go:64] FLAG: --qos-reserved=""
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916475    2575 flags.go:64] FLAG: --read-only-port="10255"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916478    2575 flags.go:64] FLAG: --register-node="true"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916481    2575 flags.go:64] FLAG: --register-schedulable="true"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916484    2575 flags.go:64] FLAG: --register-with-taints=""
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916488    2575 flags.go:64] FLAG: --registry-burst="10"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916490    2575 flags.go:64] FLAG: --registry-qps="5"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916494    2575 flags.go:64] FLAG: --reserved-cpus=""
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916497    2575 flags.go:64] FLAG: --reserved-memory=""
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916500    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916503    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916506    2575 flags.go:64] FLAG: --rotate-certificates="false"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916509    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916513    2575 flags.go:64] FLAG: --runonce="false"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916516    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916519    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916522    2575 flags.go:64] FLAG: --seccomp-default="false"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916525    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916527    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 20 20:19:53.922056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916531    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916534    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916537    2575 flags.go:64] FLAG: --storage-driver-password="root"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916540    2575 flags.go:64] FLAG: --storage-driver-secure="false"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916547    2575 flags.go:64] FLAG: --storage-driver-table="stats"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916550    2575 flags.go:64] FLAG: --storage-driver-user="root"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916553    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916556    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916559    2575 flags.go:64] FLAG: --system-cgroups=""
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916562    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916568    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916571    2575 flags.go:64] FLAG: --tls-cert-file=""
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916574    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916578    2575 flags.go:64] FLAG: --tls-min-version=""
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916581    2575 flags.go:64] FLAG: --tls-private-key-file=""
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916584    2575 flags.go:64] FLAG: --topology-manager-policy="none"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916586    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916589    2575 flags.go:64] FLAG: --topology-manager-scope="container"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916592    2575 flags.go:64] FLAG: --v="2"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916597    2575 flags.go:64] FLAG: --version="false"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916601    2575 flags.go:64] FLAG: --vmodule=""
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916605    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.916608    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916704    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916709    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:19:53.922716 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916712    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916715    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916717    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916720    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916723    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916725    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916728    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916731    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916733    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916736    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916738    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916743    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916746    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916748    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916751    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916754    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916757    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916759    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916762    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:19:53.923319 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916764    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916767    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916769    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916772    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916774    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916777    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916780    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916782    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916785    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916787    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916790    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916792    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916798    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916801    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916805    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916808    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916811    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916815    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916818    2575 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:19:53.923790 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916821    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916824    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916827    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916830    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916832    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916836    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916839    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916841    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916844    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916847    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916849    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916852    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916854    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916857    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916860    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916862    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916865    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916867    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916870    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916872    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:19:53.924299 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916875    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916877    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916880    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916883    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916885    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916889    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916891    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916894    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916896    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916899    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916902    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916905    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916907    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916909    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916912    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916915    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916917    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916921    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916924    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916926    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:19:53.924808 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916929    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916931    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916934    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916937    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916939    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.916942    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.917446    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.923664    2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.923681    2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923728    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923733    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923736    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923739    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923741    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923744    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:19:53.925423 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923747    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923750    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923753    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923756    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923758    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923761    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923763    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923766    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923768    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923770    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923773    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923777    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923780    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923784    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923789    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923792    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923795    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923798    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923801    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:19:53.925794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923804    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923807    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923810    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923813    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923816    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923819    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923823    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923826    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923829    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923832    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923835    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923837    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923840    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923843    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923846    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923848    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923851    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923854    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923856    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923859    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:19:53.926261 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923861    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923864    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923867    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923869    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923871    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923874    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923876    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923879    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923881    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923884    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923886    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923889    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923891    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923894    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923896    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923899    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923902    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923904    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923907    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923910    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:19:53.926737 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923913    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923916    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923918    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923921    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923923    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923926    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923928    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923931    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923933    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923936    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923938    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923942    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923944    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923946    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923949    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923951    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923954    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923956    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923959    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923961    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:19:53.927235 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.923964    2575 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.923969    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924096    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924102    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924106    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924110    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924113    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924116    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924119    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924122    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924125    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924129    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924132    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924135    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924137    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 20:19:53.927708 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924140    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924143    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924145    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924148    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924150    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924153    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924156    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924158    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924161    2575 feature_gate.go:328] unrecognized feature gate: Example
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924163    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924167    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924171    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924173    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924176    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924178    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924181    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924184    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924186    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924206    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924210    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 20:19:53.928097 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924213    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924215    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924218    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924221    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924223    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924226    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924228    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924231    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924235    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924238    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924241    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924244    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924247    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924249    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924252    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924254    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924257    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924259    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924262    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924265    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 20:19:53.928607 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924267    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924270    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924273    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924275    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924278    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924280    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924283    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924285    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924288    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924290    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924293    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924295    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924298    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924300    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924303    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924305    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924327    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924331    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924334    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 20:19:53.929096 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924337    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924341    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924343    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924346    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924349    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924352    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924355    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924358    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924360    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924363    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924366    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924368    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924371    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:53.924373    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.924377    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 20:19:53.929700 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.925141    2575 server.go:962] "Client rotation is on, will bootstrap in background"
May 20 20:19:53.930058 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.929213    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 20 20:19:53.931014 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.931002    2575 server.go:1019] "Starting client certificate rotation"
May 20 20:19:53.931125 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.931106    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 20:19:53.931960 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.931946    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 20:19:53.960310 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.960279    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 20:19:53.965160 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.965128    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 20:19:53.984664 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.984637    2575 log.go:25] "Validated CRI v1 runtime API"
May 20 20:19:53.990395 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.990377    2575 log.go:25] "Validated CRI v1 image API"
May 20 20:19:53.991606 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.991590    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 20:19:53.993580 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:53.993558    2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 20 20:19:54.002373 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.002352    2575 fs.go:135] Filesystem UUIDs: map[0f33f957-7313-4236-a7d5-959be468120a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a1134768-075b-4dbe-823b-d2ba965f05ea:/dev/nvme0n1p4]
May 20 20:19:54.002416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.002373    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 20 20:19:54.006673 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.006534    2575 manager.go:217] Machine: {Timestamp:2026-05-20 20:19:54.006050348 +0000 UTC m=+0.452632555 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3163438 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec281b3579d9a687d193efac153b80e8 SystemUUID:ec281b35-79d9-a687-d193-efac153b80e8 BootID:3a2c5435-87c5-4913-ad8e-38bdeea0565a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cd:55:dd:84:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cd:55:dd:84:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:7b:1d:68:1d:84 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 20 20:19:54.007505 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.007495    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 20 20:19:54.007593 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.007580    2575 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 20 20:19:54.009465 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.009439    2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 20 20:19:54.009599 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.009468    2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 20 20:19:54.009643 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.009608    2575 topology_manager.go:138] "Creating topology manager with none policy"
May 20 20:19:54.009643 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.009618    2575 container_manager_linux.go:306] "Creating device plugin manager"
May 20 20:19:54.009643 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.009626    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 20:19:54.010104 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.010095    2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 20:19:54.011645 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.011635    2575 state_mem.go:36] "Initialized new in-memory state store"
May 20 20:19:54.011756 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.011747    2575 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 20 20:19:54.015179 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.015167    2575 kubelet.go:491] "Attempting to sync node with API server"
May 20 20:19:54.015263 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.015183    2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 20 20:19:54.015263 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.015211    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 20 20:19:54.015263 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.015220    2575 kubelet.go:397] "Adding apiserver pod source"
May 20 20:19:54.015263 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.015229    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 20 20:19:54.015426 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.015238    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wr99t"
May 20 20:19:54.016429 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.016415    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 20:19:54.016509 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.016433    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 20:19:54.019794 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.019778    2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 20 20:19:54.021684 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.021667    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wr99t"
May 20 20:19:54.021748 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.021717    2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 20 20:19:54.024362 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024346    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 20 20:19:54.024435 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024370    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 20 20:19:54.024435 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024384    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 20 20:19:54.024435 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024392    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 20 20:19:54.024435 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024405    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 20 20:19:54.024435 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024415    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 20 20:19:54.024435 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024424    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 20 20:19:54.024435 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024433    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 20 20:19:54.024624 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024444    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 20 20:19:54.024624 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024453    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 20 20:19:54.024624 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024465    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 20 20:19:54.024624 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.024474    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 20 20:19:54.025431 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.025418    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 20 20:19:54.025431 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.025433    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 20 20:19:54.030885 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.030863    2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:54.030885 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.030877    2575 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 20 20:19:54.031010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.030927    2575 server.go:1295] "Started kubelet"
May 20 20:19:54.031496 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.031441    2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 20 20:19:54.031593 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.031508    2575 server_v1.go:47] "podresources" method="list" useActivePods=true
May 20 20:19:54.031852 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.031810    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 20 20:19:54.031943 ip-10-0-138-220 systemd[1]: Started Kubernetes Kubelet.
May 20 20:19:54.033410 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.033385    2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 20 20:19:54.039957 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.039932    2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:54.040184 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.040169    2575 server.go:317] "Adding debug handlers to kubelet server"
May 20 20:19:54.040857 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.040839    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 20 20:19:54.040977 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.040963    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 20 20:19:54.041183 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.041049    2575 volume_manager.go:295] "The desired_state_of_world populator starts"
May 20 20:19:54.041183 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.041084    2575 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 20 20:19:54.041354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.041233    2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 20 20:19:54.041354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.041287    2575 reconstruct.go:97] "Volume reconstruction finished"
May 20 20:19:54.041354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.041300    2575 reconciler.go:26] "Reconciler: start to sync state"
May 20 20:19:54.041760 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.041744    2575 factory.go:55] Registering systemd factory
May 20 20:19:54.041827 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.041766    2575 factory.go:223] Registration of the systemd container factory successfully
May 20 20:19:54.042066 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:54.041900    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-220.ec2.internal\" not found"
May 20 20:19:54.042066 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.041968    2575 factory.go:153] Registering CRI-O factory
May 20 20:19:54.042066 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.041982    2575 factory.go:223] Registration of the crio container factory successfully
May 20 20:19:54.042066 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.042034    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 20 20:19:54.042066 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.042053    2575 factory.go:103] Registering Raw factory
May 20 20:19:54.042066 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.042069    2575 manager.go:1196] Started watching for new ooms in manager
May 20 20:19:54.042515 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.042496    2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-220.ec2.internal" not found
May 20 20:19:54.044013 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.043998    2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:54.044175 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.044157    2575 manager.go:319] Starting recovery of all containers
May 20 20:19:54.045507 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:54.045470    2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 20 20:19:54.045597 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:54.045570    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-220.ec2.internal\" not found" node="ip-10-0-138-220.ec2.internal"
May 20 20:19:54.053943 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.053803    2575 manager.go:324] Recovery completed
May 20 20:19:54.057410 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.057395    2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-220.ec2.internal" not found
May 20 20:19:54.058239 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.058227    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:19:54.059911 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.059897    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-220.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:19:54.059968 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.059923    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-220.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:19:54.059968 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.059932    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-220.ec2.internal" event="NodeHasSufficientPID"
May 20 20:19:54.060437 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.060421    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 20 20:19:54.060437 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.060433    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 20 20:19:54.060541 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.060453    2575 state_mem.go:36] "Initialized new in-memory state store"
May 20 20:19:54.063014 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.063002    2575 policy_none.go:49] "None policy: Start"
May 20 20:19:54.063055 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.063017    2575 memory_manager.go:186] "Starting memorymanager" policy="None"
May 20 20:19:54.063055 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.063027    2575 state_mem.go:35] "Initializing new in-memory state store"
May 20 20:19:54.110804 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.110786    2575 manager.go:341] "Starting Device Plugin manager"
May 20 20:19:54.111913 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:54.110829    2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 20 20:19:54.111913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.110841    2575 server.go:85] "Starting device plugin registration server"
May 20 20:19:54.111913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.111151    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
May 20 20:19:54.111913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.111163    2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 20 20:19:54.111913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.111337    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 20 20:19:54.111913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.111422    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 20 20:19:54.111913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.111429    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 20 20:19:54.111913 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:54.111836    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 20 20:19:54.111913 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:54.111870    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-220.ec2.internal\" not found"
May 20 20:19:54.114647 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.114631    2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-220.ec2.internal" not found
May 20 20:19:54.136796 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.136767    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 20 20:19:54.138054 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.138034    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 20 20:19:54.138131 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.138064    2575 status_manager.go:230] "Starting to sync pod status with apiserver"
May 20 20:19:54.138131 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.138084    2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 20 20:19:54.138131 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.138093    2575 kubelet.go:2451] "Starting kubelet main sync loop"
May 20 20:19:54.138263 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:54.138139    2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 20 20:19:54.141537 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.141514    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:54.211515 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.211451    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 20:19:54.212460 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.212445    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-220.ec2.internal" event="NodeHasSufficientMemory"
May 20 20:19:54.212530 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.212478    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-220.ec2.internal" event="NodeHasNoDiskPressure"
May 20 20:19:54.212530 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.212493    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-220.ec2.internal" event="NodeHasSufficientPID"
May 20 20:19:54.212530 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.212524    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-220.ec2.internal"
May 20 20:19:54.220463 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.220446    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-220.ec2.internal"
May 20 20:19:54.238990 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.238956    2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"]
May 20 20:19:54.241041 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.241027    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.241297 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.241281    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.241372 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.241284    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.254887 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.254872    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 20:19:54.255596 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.255584    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.267850 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.267834    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.270843 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.270829    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 20:19:54.272327 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.272311    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.292950 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.292932    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 20:19:54.293022 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:54.292971    2575 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-220.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.299873 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.299861    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 20:19:54.299937 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:54.299891    2575 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.341946 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.341912    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fcaf49d3bd9983480bea8efd144c48e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal\" (UID: \"fcaf49d3bd9983480bea8efd144c48e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.341946 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.341947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcaf49d3bd9983480bea8efd144c48e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal\" (UID: \"fcaf49d3bd9983480bea8efd144c48e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.342114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.341966    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/742e74dfb476718f2640591828e6c470-config\") pod \"kube-apiserver-proxy-ip-10-0-138-220.ec2.internal\" (UID: \"742e74dfb476718f2640591828e6c470\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.442882 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.442859    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/742e74dfb476718f2640591828e6c470-config\") pod \"kube-apiserver-proxy-ip-10-0-138-220.ec2.internal\" (UID: \"742e74dfb476718f2640591828e6c470\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.442882 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.442883    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fcaf49d3bd9983480bea8efd144c48e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal\" (UID: \"fcaf49d3bd9983480bea8efd144c48e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.443042 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.442907    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcaf49d3bd9983480bea8efd144c48e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal\" (UID: \"fcaf49d3bd9983480bea8efd144c48e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.443042 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.442947    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcaf49d3bd9983480bea8efd144c48e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal\" (UID: \"fcaf49d3bd9983480bea8efd144c48e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.443042 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.442968    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fcaf49d3bd9983480bea8efd144c48e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal\" (UID: \"fcaf49d3bd9983480bea8efd144c48e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.443042 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.442972    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/742e74dfb476718f2640591828e6c470-config\") pod \"kube-apiserver-proxy-ip-10-0-138-220.ec2.internal\" (UID: \"742e74dfb476718f2640591828e6c470\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.595478 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.595393    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.602912 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.602895    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal"
May 20 20:19:54.930322 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.930292    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 20 20:19:54.930863 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.930448    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 20:19:54.930863 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.930464    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 20:19:54.930863 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:54.930495    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 20:19:55.015560 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.015533    2575 apiserver.go:52] "Watching apiserver"
May 20 20:19:55.023983 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.023967    2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 20 20:19:55.024077 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.023960    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 20:14:54 +0000 UTC" deadline="2028-02-17 02:12:37.179555286 +0000 UTC"
May 20 20:19:55.024077 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.024020    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15293h52m42.155541647s"
May 20 20:19:55.025906 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.024508    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-wkv7z","openshift-multus/multus-j78m7","openshift-multus/network-metrics-daemon-5rhth","openshift-network-diagnostics/network-check-target-vhz52","openshift-network-operator/iptables-alerter-wtbg9","openshift-ovn-kubernetes/ovnkube-node-kdcdj","kube-system/konnectivity-agent-jzhww","kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr","openshift-image-registry/node-ca-dbzh4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal","openshift-multus/multus-additional-cni-plugins-6lhpb"]
May 20 20:19:55.027061 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.027047    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.029252 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.029232    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cddff\""
May 20 20:19:55.029425 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.029412    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 20 20:19:55.029505 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.029411    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 20 20:19:55.029831 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.029816    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j78m7"
May 20 20:19:55.031039 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.031021    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:19:55.031113 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.031095    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:19:55.031923 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.031909    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 20 20:19:55.032043 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.032020    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 20 20:19:55.032231 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.032216    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 20 20:19:55.032304 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.032272    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2cxxk\""
May 20 20:19:55.032365 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.032303    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 20 20:19:55.033343 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.033328    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:19:55.033428 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.033411    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:19:55.033474 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.033418    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wtbg9"
May 20 20:19:55.034638 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.034625    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.036154 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.036139    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jzhww"
May 20 20:19:55.037208 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.037176    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-csj7g\""
May 20 20:19:55.037304 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.037210    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 20 20:19:55.037304 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.037211    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 20 20:19:55.037304 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.037299    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 20 20:19:55.037927 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.037916    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.038216 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.038182    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 20 20:19:55.038415 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.038399    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 20 20:19:55.038473 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.038428    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tjbwn\""
May 20 20:19:55.038473 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.038445    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 20 20:19:55.038473 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.038461    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 20 20:19:55.038602 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.038475    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 20 20:19:55.038737 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.038726    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zlvg5\""
May 20 20:19:55.039018 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.039007    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 20 20:19:55.039052 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.039009    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 20 20:19:55.039243 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.039178    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 20 20:19:55.039310 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.039259    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dbzh4"
May 20 20:19:55.040484 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.040471    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 20 20:19:55.040833 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.040817    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.040921 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.040908    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 20 20:19:55.041093 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.041083    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 20 20:19:55.041364 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.041349    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sdbng\""
May 20 20:19:55.041785 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.041772    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 20 20:19:55.042066 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.042053    2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 20 20:19:55.043328 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.043309    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 20 20:19:55.043413 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.043313    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 20 20:19:55.043413 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.043361    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 20 20:19:55.043413 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.043397    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 20 20:19:55.043546 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.043512    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 20 20:19:55.043620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.043606    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mg6lw\""
May 20 20:19:55.043946 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.043931    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jkbw6\""
May 20 20:19:55.044335 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044320    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-conf-dir\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.044398 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/159c1ebf-42c3-4fe7-b624-208c0435814d-host\") pod \"node-ca-dbzh4\" (UID: \"159c1ebf-42c3-4fe7-b624-208c0435814d\") " pod="openshift-image-registry/node-ca-dbzh4"
May 20 20:19:55.044398 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044358    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-modprobe-d\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.044398 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044375    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-tmp\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.044529 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044409    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5-iptables-alerter-script\") pod \"iptables-alerter-wtbg9\" (UID: \"ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5\") " pod="openshift-network-operator/iptables-alerter-wtbg9"
May 20 20:19:55.044529 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044424    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-system-cni-dir\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.044529 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044441    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8ndx\" (UniqueName: \"kubernetes.io/projected/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-kube-api-access-v8ndx\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.044529 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-run-k8s-cni-cncf-io\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.044529 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1024ee22-2e8f-410b-be16-302ef6e7b0eb-konnectivity-ca\") pod \"konnectivity-agent-jzhww\" (UID: \"1024ee22-2e8f-410b-be16-302ef6e7b0eb\") " pod="kube-system/konnectivity-agent-jzhww"
May 20 20:19:55.044529 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7tq\" (UniqueName: \"kubernetes.io/projected/ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5-kube-api-access-2j7tq\") pod \"iptables-alerter-wtbg9\" (UID: \"ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5\") " pod="openshift-network-operator/iptables-alerter-wtbg9"
May 20 20:19:55.044749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-slash\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.044749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-kubernetes\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.044749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044592    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-systemd\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.044749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-host\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.044749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044625    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-log-socket\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.044749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-var-lib-kubelet\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.044749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-cni-netd\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.044749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-cnibin\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.044749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-cni-dir\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.044749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:19:55.044749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044732    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-sys-fs\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044765    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-os-release\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-socket-dir-parent\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044810    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-run-netns\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044827    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-var-lib-cni-multus\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xtld\" (UniqueName: \"kubernetes.io/projected/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-kube-api-access-4xtld\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-registration-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-device-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.044973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kcqh\" (UniqueName: \"kubernetes.io/projected/59f569cb-5ecd-41a0-8d28-5cc6a76211af-kube-api-access-2kcqh\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1024ee22-2e8f-410b-be16-302ef6e7b0eb-agent-certs\") pod \"konnectivity-agent-jzhww\" (UID: \"1024ee22-2e8f-410b-be16-302ef6e7b0eb\") " pod="kube-system/konnectivity-agent-jzhww"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045024    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-hostroot\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045044    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2f9p\" (UniqueName: \"kubernetes.io/projected/b58b9421-7735-48d6-ae02-be449d7adfb9-kube-api-access-c2f9p\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-kubelet\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045084    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-sys\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.045141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-system-cni-dir\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.045745 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-var-lib-kubelet\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.045745 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59f569cb-5ecd-41a0-8d28-5cc6a76211af-ovn-node-metrics-cert\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.045745 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045224    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7\") pod \"network-check-target-vhz52\" (UID: \"0a6c4f77-30a4-414a-8c74-5d627a46b507\") " pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:19:55.045745 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045249    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-lib-modules\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.045745 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045287    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-os-release\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-daemon-config\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045854    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59f569cb-5ecd-41a0-8d28-5cc6a76211af-env-overrides\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59f569cb-5ecd-41a0-8d28-5cc6a76211af-ovnkube-script-lib\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.045923    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5-host-slash\") pod \"iptables-alerter-wtbg9\" (UID: \"ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5\") " pod="openshift-network-operator/iptables-alerter-wtbg9"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-var-lib-cni-bin\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046134    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-cni-bin\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-socket-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046213    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046246    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-systemd-units\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-sysconfig\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.046342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-node-log\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.046847 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046359    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59f569cb-5ecd-41a0-8d28-5cc6a76211af-ovnkube-config\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.046847 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046392    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.046847 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.046847 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-etc-kubernetes\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.046847 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046478    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-run-systemd\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.046847 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046508    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-run-openvswitch\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.046847 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.046847 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.046847 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-cnibin\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.046847 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046815    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-cni-binary-copy\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.047270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046854    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-run-netns\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.047270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-var-lib-openvswitch\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.047270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-run-ovn\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.047270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.046987    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl8qh\" (UniqueName: \"kubernetes.io/projected/159c1ebf-42c3-4fe7-b624-208c0435814d-kube-api-access-wl8qh\") pod \"node-ca-dbzh4\" (UID: \"159c1ebf-42c3-4fe7-b624-208c0435814d\") " pod="openshift-image-registry/node-ca-dbzh4"
May 20 20:19:55.047270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.047018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-run\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.047270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.047074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-etc-openvswitch\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.047270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.047102    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2zw8\" (UniqueName: \"kubernetes.io/projected/1728d36a-b398-46f8-852f-dc4bdca06ac1-kube-api-access-f2zw8\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.047270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.047145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/159c1ebf-42c3-4fe7-b624-208c0435814d-serviceca\") pod \"node-ca-dbzh4\" (UID: \"159c1ebf-42c3-4fe7-b624-208c0435814d\") " pod="openshift-image-registry/node-ca-dbzh4"
May 20 20:19:55.047270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.047182    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-sysctl-conf\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.047270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.047230    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-tuned\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.047681 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.047268    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-run-multus-certs\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.047681 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.047316    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.047681 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.047363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-sysctl-d\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.047681 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.047394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfmvp\" (UniqueName: \"kubernetes.io/projected/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-kube-api-access-zfmvp\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.057144 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.057125    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 20:19:55.123273 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.123249    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5pgrm"
May 20 20:19:55.129937 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.129915    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5pgrm"
May 20 20:19:55.148058 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148038    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-system-cni-dir\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.148182 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148082    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8ndx\" (UniqueName: \"kubernetes.io/projected/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-kube-api-access-v8ndx\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.148182 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148101    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-run-k8s-cni-cncf-io\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.148182 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148132    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1024ee22-2e8f-410b-be16-302ef6e7b0eb-konnectivity-ca\") pod \"konnectivity-agent-jzhww\" (UID: \"1024ee22-2e8f-410b-be16-302ef6e7b0eb\") " pod="kube-system/konnectivity-agent-jzhww"
May 20 20:19:55.148182 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148138    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-system-cni-dir\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.148182 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148149    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7tq\" (UniqueName: \"kubernetes.io/projected/ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5-kube-api-access-2j7tq\") pod \"iptables-alerter-wtbg9\" (UID: \"ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5\") " pod="openshift-network-operator/iptables-alerter-wtbg9"
May 20 20:19:55.148182 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148179    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-slash\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148227    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-kubernetes\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148248    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-systemd\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148248    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-run-k8s-cni-cncf-io\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148269    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-host\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148283    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-slash\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148295    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-log-socket\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148303    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-kubernetes\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148309    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-systemd\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148330    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-log-socket\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148341    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-var-lib-kubelet\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148350    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-host\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148374    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-cni-netd\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148399    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-cni-netd\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148416    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-cnibin\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148417    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-var-lib-kubelet\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148437    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-cni-dir\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148453    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:19:55.148500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148478    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-cnibin\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148487    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-sys-fs\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148526    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-sys-fs\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148545    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-cni-dir\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148575    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-os-release\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148604    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-socket-dir-parent\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148647    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-os-release\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148687    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-socket-dir-parent\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.148745    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1024ee22-2e8f-410b-be16-302ef6e7b0eb-konnectivity-ca\") pod \"konnectivity-agent-jzhww\" (UID: \"1024ee22-2e8f-410b-be16-302ef6e7b0eb\") " pod="kube-system/konnectivity-agent-jzhww"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149000    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-run-netns\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149028    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-run-netns\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149029    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-var-lib-cni-multus\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.149048    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149056    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-var-lib-cni-multus\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.149111    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs podName:b58b9421-7735-48d6-ae02-be449d7adfb9 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:55.649089964 +0000 UTC m=+2.095672180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs") pod "network-metrics-daemon-5rhth" (UID: "b58b9421-7735-48d6-ae02-be449d7adfb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149054    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xtld\" (UniqueName: \"kubernetes.io/projected/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-kube-api-access-4xtld\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149159    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.149353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149177    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-registration-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149219    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-device-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149239    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-run-ovn-kubernetes\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149250    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-registration-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149251    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kcqh\" (UniqueName: \"kubernetes.io/projected/59f569cb-5ecd-41a0-8d28-5cc6a76211af-kube-api-access-2kcqh\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149304    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-device-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149313    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1024ee22-2e8f-410b-be16-302ef6e7b0eb-agent-certs\") pod \"konnectivity-agent-jzhww\" (UID: \"1024ee22-2e8f-410b-be16-302ef6e7b0eb\") " pod="kube-system/konnectivity-agent-jzhww"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149332    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-hostroot\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149348    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2f9p\" (UniqueName: \"kubernetes.io/projected/b58b9421-7735-48d6-ae02-be449d7adfb9-kube-api-access-c2f9p\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149362    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-kubelet\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149376    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-sys\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149387    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-hostroot\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149391    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-system-cni-dir\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149423    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-var-lib-kubelet\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149426    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-system-cni-dir\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149426    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-kubelet\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149445    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-sys\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149447    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59f569cb-5ecd-41a0-8d28-5cc6a76211af-ovn-node-metrics-cert\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.150126 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149470    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-var-lib-kubelet\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149475    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7\") pod \"network-check-target-vhz52\" (UID: \"0a6c4f77-30a4-414a-8c74-5d627a46b507\") " pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149491    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-lib-modules\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149511    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-os-release\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149533    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-daemon-config\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149553    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59f569cb-5ecd-41a0-8d28-5cc6a76211af-env-overrides\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149574    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59f569cb-5ecd-41a0-8d28-5cc6a76211af-ovnkube-script-lib\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149614    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149626    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-lib-modules\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149613    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-os-release\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149644    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5-host-slash\") pod \"iptables-alerter-wtbg9\" (UID: \"ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5\") " pod="openshift-network-operator/iptables-alerter-wtbg9"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149672    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-var-lib-cni-bin\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149703    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-cni-bin\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149728    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5-host-slash\") pod \"iptables-alerter-wtbg9\" (UID: \"ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5\") " pod="openshift-network-operator/iptables-alerter-wtbg9"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149739    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-socket-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149765    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149774    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-var-lib-cni-bin\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149790    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-systemd-units\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.150878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149834    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149858    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-sysconfig\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149869    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-socket-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149881    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-node-log\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149904    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59f569cb-5ecd-41a0-8d28-5cc6a76211af-ovnkube-config\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149908    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-cni-bin\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149932    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149959    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.149984    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-etc-kubernetes\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150009    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-run-systemd\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150017    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150032    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-run-openvswitch\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150056    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150072    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-systemd-units\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150088    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150112    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-cnibin\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150133    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59f569cb-5ecd-41a0-8d28-5cc6a76211af-env-overrides\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.151872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150145    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-cni-binary-copy\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150155    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-node-log\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150168    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-run-netns\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150220    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-var-lib-openvswitch\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150222    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-sysconfig\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150116    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-daemon-config\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150243    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-run-ovn\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150256    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1728d36a-b398-46f8-852f-dc4bdca06ac1-etc-selinux\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150281    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59f569cb-5ecd-41a0-8d28-5cc6a76211af-ovnkube-script-lib\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150288    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-run-ovn\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150298    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-etc-kubernetes\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150314    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wl8qh\" (UniqueName: \"kubernetes.io/projected/159c1ebf-42c3-4fe7-b624-208c0435814d-kube-api-access-wl8qh\") pod \"node-ca-dbzh4\" (UID: \"159c1ebf-42c3-4fe7-b624-208c0435814d\") " pod="openshift-image-registry/node-ca-dbzh4"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150341    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-run-systemd\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150385    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-run-openvswitch\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150367    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-run\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150424    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-etc-openvswitch\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150428    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-run\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150453    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2zw8\" (UniqueName: \"kubernetes.io/projected/1728d36a-b398-46f8-852f-dc4bdca06ac1-kube-api-access-f2zw8\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.152793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150480    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/159c1ebf-42c3-4fe7-b624-208c0435814d-serviceca\") pod \"node-ca-dbzh4\" (UID: \"159c1ebf-42c3-4fe7-b624-208c0435814d\") " pod="openshift-image-registry/node-ca-dbzh4"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150505    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-sysctl-conf\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150530    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-tuned\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150575    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-run-multus-certs\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150601    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150618    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150627    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-sysctl-d\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150655    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zfmvp\" (UniqueName: \"kubernetes.io/projected/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-kube-api-access-zfmvp\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150680    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-conf-dir\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150704    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/159c1ebf-42c3-4fe7-b624-208c0435814d-host\") pod \"node-ca-dbzh4\" (UID: \"159c1ebf-42c3-4fe7-b624-208c0435814d\") " pod="openshift-image-registry/node-ca-dbzh4"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150729    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-modprobe-d\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150729    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150738    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150751    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-tmp\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150758    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59f569cb-5ecd-41a0-8d28-5cc6a76211af-ovnkube-config\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150810    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-multus-conf-dir\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150842    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-cni-binary-copy\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.153394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150844    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150904    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-host-run-netns\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150943    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-var-lib-openvswitch\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.150960    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-cnibin\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.151034    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/159c1ebf-42c3-4fe7-b624-208c0435814d-host\") pod \"node-ca-dbzh4\" (UID: \"159c1ebf-42c3-4fe7-b624-208c0435814d\") " pod="openshift-image-registry/node-ca-dbzh4"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.151065    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-sysctl-d\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.151111    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f569cb-5ecd-41a0-8d28-5cc6a76211af-etc-openvswitch\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.151114    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-modprobe-d\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.151228    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-sysctl-conf\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.151261    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5-iptables-alerter-script\") pod \"iptables-alerter-wtbg9\" (UID: \"ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5\") " pod="openshift-network-operator/iptables-alerter-wtbg9"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.151312    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.151370    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-host-run-multus-certs\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.151636    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/159c1ebf-42c3-4fe7-b624-208c0435814d-serviceca\") pod \"node-ca-dbzh4\" (UID: \"159c1ebf-42c3-4fe7-b624-208c0435814d\") " pod="openshift-image-registry/node-ca-dbzh4"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.151778    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5-iptables-alerter-script\") pod \"iptables-alerter-wtbg9\" (UID: \"ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5\") " pod="openshift-network-operator/iptables-alerter-wtbg9"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.153026    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-tmp\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.153394    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-etc-tuned\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.153403    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1024ee22-2e8f-410b-be16-302ef6e7b0eb-agent-certs\") pod \"konnectivity-agent-jzhww\" (UID: \"1024ee22-2e8f-410b-be16-302ef6e7b0eb\") " pod="kube-system/konnectivity-agent-jzhww"
May 20 20:19:55.153840 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.153607    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59f569cb-5ecd-41a0-8d28-5cc6a76211af-ovn-node-metrics-cert\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.156607 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.156590    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:19:55.156674 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.156609    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:19:55.156674 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.156619    2575 projected.go:194] Error preparing data for projected volume kube-api-access-jkdn7 for pod openshift-network-diagnostics/network-check-target-vhz52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:55.156674 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.156667    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7 podName:0a6c4f77-30a4-414a-8c74-5d627a46b507 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:55.656651381 +0000 UTC m=+2.103233594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jkdn7" (UniqueName: "kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7") pod "network-check-target-vhz52" (UID: "0a6c4f77-30a4-414a-8c74-5d627a46b507") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:55.159437 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.159407    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8ndx\" (UniqueName: \"kubernetes.io/projected/f2070d17-2dcd-4182-8d03-ca05d20ac2c9-kube-api-access-v8ndx\") pod \"multus-additional-cni-plugins-6lhpb\" (UID: \"f2070d17-2dcd-4182-8d03-ca05d20ac2c9\") " pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.159529 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.159420    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7tq\" (UniqueName: \"kubernetes.io/projected/ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5-kube-api-access-2j7tq\") pod \"iptables-alerter-wtbg9\" (UID: \"ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5\") " pod="openshift-network-operator/iptables-alerter-wtbg9"
May 20 20:19:55.159752 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.159728    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xtld\" (UniqueName: \"kubernetes.io/projected/55c4fdfe-baec-4dad-ac0c-82e45752d1b7-kube-api-access-4xtld\") pod \"multus-j78m7\" (UID: \"55c4fdfe-baec-4dad-ac0c-82e45752d1b7\") " pod="openshift-multus/multus-j78m7"
May 20 20:19:55.163710 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.163688    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfmvp\" (UniqueName: \"kubernetes.io/projected/cf65f086-d86f-4332-9ea5-89a74e7ce9e3-kube-api-access-zfmvp\") pod \"tuned-wkv7z\" (UID: \"cf65f086-d86f-4332-9ea5-89a74e7ce9e3\") " pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.163803 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.163711    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl8qh\" (UniqueName: \"kubernetes.io/projected/159c1ebf-42c3-4fe7-b624-208c0435814d-kube-api-access-wl8qh\") pod \"node-ca-dbzh4\" (UID: \"159c1ebf-42c3-4fe7-b624-208c0435814d\") " pod="openshift-image-registry/node-ca-dbzh4"
May 20 20:19:55.163803 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.163733    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2zw8\" (UniqueName: \"kubernetes.io/projected/1728d36a-b398-46f8-852f-dc4bdca06ac1-kube-api-access-f2zw8\") pod \"aws-ebs-csi-driver-node-9sfdr\" (UID: \"1728d36a-b398-46f8-852f-dc4bdca06ac1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.164226 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.163850    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kcqh\" (UniqueName: \"kubernetes.io/projected/59f569cb-5ecd-41a0-8d28-5cc6a76211af-kube-api-access-2kcqh\") pod \"ovnkube-node-kdcdj\" (UID: \"59f569cb-5ecd-41a0-8d28-5cc6a76211af\") " pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.164598 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.164579    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2f9p\" (UniqueName: \"kubernetes.io/projected/b58b9421-7735-48d6-ae02-be449d7adfb9-kube-api-access-c2f9p\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:19:55.196997 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:55.196970    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742e74dfb476718f2640591828e6c470.slice/crio-8a523a7182ec8a1b34a1d5729c2b6d5d88c4eb24d1c319c4380a8efde38682f4 WatchSource:0}: Error finding container 8a523a7182ec8a1b34a1d5729c2b6d5d88c4eb24d1c319c4380a8efde38682f4: Status 404 returned error can't find the container with id 8a523a7182ec8a1b34a1d5729c2b6d5d88c4eb24d1c319c4380a8efde38682f4
May 20 20:19:55.197237 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:55.197217    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcaf49d3bd9983480bea8efd144c48e3.slice/crio-d9e99220a739cf0fcd832cf0ee02a9c5f172946ce6d0832ade56fe117efc0086 WatchSource:0}: Error finding container d9e99220a739cf0fcd832cf0ee02a9c5f172946ce6d0832ade56fe117efc0086: Status 404 returned error can't find the container with id d9e99220a739cf0fcd832cf0ee02a9c5f172946ce6d0832ade56fe117efc0086
May 20 20:19:55.200184 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.200170    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:19:55.361269 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.361248    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wkv7z"
May 20 20:19:55.366879 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:55.366852    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf65f086_d86f_4332_9ea5_89a74e7ce9e3.slice/crio-8d14a27b9265db6da60a9169f72a26b071c80538c41b87ecd527c3d201b9a4e0 WatchSource:0}: Error finding container 8d14a27b9265db6da60a9169f72a26b071c80538c41b87ecd527c3d201b9a4e0: Status 404 returned error can't find the container with id 8d14a27b9265db6da60a9169f72a26b071c80538c41b87ecd527c3d201b9a4e0
May 20 20:19:55.377167 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.377145    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j78m7"
May 20 20:19:55.377795 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.377778    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-r2r4m"]
May 20 20:19:55.380095 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.380062    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:55.380187 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.380141    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:19:55.383312 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:55.383289    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c4fdfe_baec_4dad_ac0c_82e45752d1b7.slice/crio-e2c74f36eaafa5213276e11171b81b90eda36e014e500fe43e32370fbd92a4d1 WatchSource:0}: Error finding container e2c74f36eaafa5213276e11171b81b90eda36e014e500fe43e32370fbd92a4d1: Status 404 returned error can't find the container with id e2c74f36eaafa5213276e11171b81b90eda36e014e500fe43e32370fbd92a4d1
May 20 20:19:55.395343 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.395326    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wtbg9"
May 20 20:19:55.401507 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:55.401483    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea70fe5f_f8d3_4ea1_acd8_9b68c36bd5a5.slice/crio-b43e1b4e3b50d86823f4d6647f09f468cf043e7505e48fb62b68a800ee682665 WatchSource:0}: Error finding container b43e1b4e3b50d86823f4d6647f09f468cf043e7505e48fb62b68a800ee682665: Status 404 returned error can't find the container with id b43e1b4e3b50d86823f4d6647f09f468cf043e7505e48fb62b68a800ee682665
May 20 20:19:55.404314 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.404299    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:19:55.411715 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:55.411695    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f569cb_5ecd_41a0_8d28_5cc6a76211af.slice/crio-49c912c6004663a64af77fe404b806632117de75c31f8a809a5d4d395c4a3e60 WatchSource:0}: Error finding container 49c912c6004663a64af77fe404b806632117de75c31f8a809a5d4d395c4a3e60: Status 404 returned error can't find the container with id 49c912c6004663a64af77fe404b806632117de75c31f8a809a5d4d395c4a3e60
May 20 20:19:55.420338 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.420319    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jzhww"
May 20 20:19:55.426121 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:55.426100    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1024ee22_2e8f_410b_be16_302ef6e7b0eb.slice/crio-9850d8107f1dd2b554f78583f53570eda0802345d7073378997f31c26965d74c WatchSource:0}: Error finding container 9850d8107f1dd2b554f78583f53570eda0802345d7073378997f31c26965d74c: Status 404 returned error can't find the container with id 9850d8107f1dd2b554f78583f53570eda0802345d7073378997f31c26965d74c
May 20 20:19:55.435639 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.435576    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr"
May 20 20:19:55.441489 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:55.441462    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1728d36a_b398_46f8_852f_dc4bdca06ac1.slice/crio-a2177092830bd9f150cef293f375ca9d7d5d25e4820f08cfbe017cfd1e1a58f5 WatchSource:0}: Error finding container a2177092830bd9f150cef293f375ca9d7d5d25e4820f08cfbe017cfd1e1a58f5: Status 404 returned error can't find the container with id a2177092830bd9f150cef293f375ca9d7d5d25e4820f08cfbe017cfd1e1a58f5
May 20 20:19:55.442367 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.442351    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dbzh4"
May 20 20:19:55.447418 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.447401    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6lhpb"
May 20 20:19:55.447999 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:55.447981    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159c1ebf_42c3_4fe7_b624_208c0435814d.slice/crio-3d05a84c20e84afc51f1ec901f96e5024df02f23f2181c085db98d5be696de00 WatchSource:0}: Error finding container 3d05a84c20e84afc51f1ec901f96e5024df02f23f2181c085db98d5be696de00: Status 404 returned error can't find the container with id 3d05a84c20e84afc51f1ec901f96e5024df02f23f2181c085db98d5be696de00
May 20 20:19:55.453385 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.453364    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:55.453473 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.453449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-kubelet-config\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:55.453532 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.453478    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-dbus\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:55.453532 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:19:55.453522    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2070d17_2dcd_4182_8d03_ca05d20ac2c9.slice/crio-af726779bbdc17dfe2bd3d88d51acb7e3c48737404e6e93e667c42cf6b3db814 WatchSource:0}: Error finding container af726779bbdc17dfe2bd3d88d51acb7e3c48737404e6e93e667c42cf6b3db814: Status 404 returned error can't find the container with id af726779bbdc17dfe2bd3d88d51acb7e3c48737404e6e93e667c42cf6b3db814
May 20 20:19:55.554721 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.554692    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-dbus\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:55.554890 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.554749    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:55.554890 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.554795    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-kubelet-config\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:55.554890 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.554869    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-kubelet-config\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:55.555188 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.555003    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-dbus\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:55.555188 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.555092    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:19:55.555188 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.555152    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret podName:e02a3a83-a1de-4d01-b205-7fb737a4c5cc nodeName:}" failed. No retries permitted until 2026-05-20 20:19:56.055134059 +0000 UTC m=+2.501716266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret") pod "global-pull-secret-syncer-r2r4m" (UID: "e02a3a83-a1de-4d01-b205-7fb737a4c5cc") : object "kube-system"/"original-pull-secret" not registered
May 20 20:19:55.655499 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.655466    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:19:55.655674 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.655649    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:55.655813 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.655780    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs podName:b58b9421-7735-48d6-ae02-be449d7adfb9 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:56.655687997 +0000 UTC m=+3.102270207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs") pod "network-metrics-daemon-5rhth" (UID: "b58b9421-7735-48d6-ae02-be449d7adfb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:55.756681 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.756598    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7\") pod \"network-check-target-vhz52\" (UID: \"0a6c4f77-30a4-414a-8c74-5d627a46b507\") " pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:19:55.756833 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.756800    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:19:55.756833 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.756820    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:19:55.756833 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.756832    2575 projected.go:194] Error preparing data for projected volume kube-api-access-jkdn7 for pod openshift-network-diagnostics/network-check-target-vhz52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:55.756988 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:55.756927    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7 podName:0a6c4f77-30a4-414a-8c74-5d627a46b507 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:56.756872213 +0000 UTC m=+3.203454417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkdn7" (UniqueName: "kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7") pod "network-check-target-vhz52" (UID: "0a6c4f77-30a4-414a-8c74-5d627a46b507") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:55.811929 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:55.811901    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:56.061017 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.060978    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:56.061678 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:56.061172    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:19:56.061678 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:56.061252    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret podName:e02a3a83-a1de-4d01-b205-7fb737a4c5cc nodeName:}" failed. No retries permitted until 2026-05-20 20:19:57.061233057 +0000 UTC m=+3.507815256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret") pod "global-pull-secret-syncer-r2r4m" (UID: "e02a3a83-a1de-4d01-b205-7fb737a4c5cc") : object "kube-system"/"original-pull-secret" not registered
May 20 20:19:56.131604 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.131462    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 20:14:55 +0000 UTC" deadline="2028-01-14 00:55:59.895852503 +0000 UTC"
May 20 20:19:56.131604 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.131508    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14476h36m3.764349694s"
May 20 20:19:56.149624 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.149539    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jzhww" event={"ID":"1024ee22-2e8f-410b-be16-302ef6e7b0eb","Type":"ContainerStarted","Data":"9850d8107f1dd2b554f78583f53570eda0802345d7073378997f31c26965d74c"}
May 20 20:19:56.161460 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.161086    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j78m7" event={"ID":"55c4fdfe-baec-4dad-ac0c-82e45752d1b7","Type":"ContainerStarted","Data":"e2c74f36eaafa5213276e11171b81b90eda36e014e500fe43e32370fbd92a4d1"}
May 20 20:19:56.164156 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.164100    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkv7z" event={"ID":"cf65f086-d86f-4332-9ea5-89a74e7ce9e3","Type":"ContainerStarted","Data":"8d14a27b9265db6da60a9169f72a26b071c80538c41b87ecd527c3d201b9a4e0"}
May 20 20:19:56.171304 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.171268    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal" event={"ID":"742e74dfb476718f2640591828e6c470","Type":"ContainerStarted","Data":"8a523a7182ec8a1b34a1d5729c2b6d5d88c4eb24d1c319c4380a8efde38682f4"}
May 20 20:19:56.187618 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.187541    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dbzh4" event={"ID":"159c1ebf-42c3-4fe7-b624-208c0435814d","Type":"ContainerStarted","Data":"3d05a84c20e84afc51f1ec901f96e5024df02f23f2181c085db98d5be696de00"}
May 20 20:19:56.192002 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.191972    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" event={"ID":"59f569cb-5ecd-41a0-8d28-5cc6a76211af","Type":"ContainerStarted","Data":"49c912c6004663a64af77fe404b806632117de75c31f8a809a5d4d395c4a3e60"}
May 20 20:19:56.201583 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.201552    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wtbg9" event={"ID":"ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5","Type":"ContainerStarted","Data":"b43e1b4e3b50d86823f4d6647f09f468cf043e7505e48fb62b68a800ee682665"}
May 20 20:19:56.205581 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.205548    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal" event={"ID":"fcaf49d3bd9983480bea8efd144c48e3","Type":"ContainerStarted","Data":"d9e99220a739cf0fcd832cf0ee02a9c5f172946ce6d0832ade56fe117efc0086"}
May 20 20:19:56.212628 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.212586    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lhpb" event={"ID":"f2070d17-2dcd-4182-8d03-ca05d20ac2c9","Type":"ContainerStarted","Data":"af726779bbdc17dfe2bd3d88d51acb7e3c48737404e6e93e667c42cf6b3db814"}
May 20 20:19:56.215804 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.215782    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr" event={"ID":"1728d36a-b398-46f8-852f-dc4bdca06ac1","Type":"ContainerStarted","Data":"a2177092830bd9f150cef293f375ca9d7d5d25e4820f08cfbe017cfd1e1a58f5"}
May 20 20:19:56.396348 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.396091    2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:56.482745 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.482713    2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 20:19:56.666658 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.665907    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:19:56.666658 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:56.666177    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:56.666658 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:56.666257    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs podName:b58b9421-7735-48d6-ae02-be449d7adfb9 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:58.666238873 +0000 UTC m=+5.112821070 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs") pod "network-metrics-daemon-5rhth" (UID: "b58b9421-7735-48d6-ae02-be449d7adfb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:56.767426 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:56.767388    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7\") pod \"network-check-target-vhz52\" (UID: \"0a6c4f77-30a4-414a-8c74-5d627a46b507\") " pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:19:56.767624 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:56.767581    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:19:56.767624 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:56.767601    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:19:56.767624 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:56.767614    2575 projected.go:194] Error preparing data for projected volume kube-api-access-jkdn7 for pod openshift-network-diagnostics/network-check-target-vhz52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:56.767900 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:56.767670    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7 podName:0a6c4f77-30a4-414a-8c74-5d627a46b507 nodeName:}" failed. No retries permitted until 2026-05-20 20:19:58.767652609 +0000 UTC m=+5.214234803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkdn7" (UniqueName: "kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7") pod "network-check-target-vhz52" (UID: "0a6c4f77-30a4-414a-8c74-5d627a46b507") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:57.070524 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:57.070351    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:57.070524 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:57.070503    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:19:57.071016 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:57.070569    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret podName:e02a3a83-a1de-4d01-b205-7fb737a4c5cc nodeName:}" failed. No retries permitted until 2026-05-20 20:19:59.070549515 +0000 UTC m=+5.517131712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret") pod "global-pull-secret-syncer-r2r4m" (UID: "e02a3a83-a1de-4d01-b205-7fb737a4c5cc") : object "kube-system"/"original-pull-secret" not registered
May 20 20:19:57.131964 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:57.131849    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 20:14:55 +0000 UTC" deadline="2028-03-03 23:06:37.012449618 +0000 UTC"
May 20 20:19:57.131964 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:57.131887    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15674h46m39.880566519s"
May 20 20:19:57.139114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:57.139091    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:57.139282 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:57.139091    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:19:57.139282 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:57.139228    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:19:57.139282 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:57.139242    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:19:57.139445 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:57.139326    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:19:57.139445 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:57.139406    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:19:58.234862 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.234714    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-z2rgw"]
May 20 20:19:58.236547 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.236524    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z2rgw"
May 20 20:19:58.239824 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.239290    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 20 20:19:58.239824 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.239499    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 20 20:19:58.239824 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.239675    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l4r8b\""
May 20 20:19:58.279707 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.279674    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8afe344-be23-4700-9ff6-95fa7d945bd8-tmp-dir\") pod \"node-resolver-z2rgw\" (UID: \"a8afe344-be23-4700-9ff6-95fa7d945bd8\") " pod="openshift-dns/node-resolver-z2rgw"
May 20 20:19:58.279878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.279757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8afe344-be23-4700-9ff6-95fa7d945bd8-hosts-file\") pod \"node-resolver-z2rgw\" (UID: \"a8afe344-be23-4700-9ff6-95fa7d945bd8\") " pod="openshift-dns/node-resolver-z2rgw"
May 20 20:19:58.279878 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.279784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m47d7\" (UniqueName: \"kubernetes.io/projected/a8afe344-be23-4700-9ff6-95fa7d945bd8-kube-api-access-m47d7\") pod \"node-resolver-z2rgw\" (UID: \"a8afe344-be23-4700-9ff6-95fa7d945bd8\") " pod="openshift-dns/node-resolver-z2rgw"
May 20 20:19:58.381089 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.381033    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8afe344-be23-4700-9ff6-95fa7d945bd8-hosts-file\") pod \"node-resolver-z2rgw\" (UID: \"a8afe344-be23-4700-9ff6-95fa7d945bd8\") " pod="openshift-dns/node-resolver-z2rgw"
May 20 20:19:58.381089 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.381085    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m47d7\" (UniqueName: \"kubernetes.io/projected/a8afe344-be23-4700-9ff6-95fa7d945bd8-kube-api-access-m47d7\") pod \"node-resolver-z2rgw\" (UID: \"a8afe344-be23-4700-9ff6-95fa7d945bd8\") " pod="openshift-dns/node-resolver-z2rgw"
May 20 20:19:58.381370 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.381131    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8afe344-be23-4700-9ff6-95fa7d945bd8-tmp-dir\") pod \"node-resolver-z2rgw\" (UID: \"a8afe344-be23-4700-9ff6-95fa7d945bd8\") " pod="openshift-dns/node-resolver-z2rgw"
May 20 20:19:58.381610 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.381495    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8afe344-be23-4700-9ff6-95fa7d945bd8-hosts-file\") pod \"node-resolver-z2rgw\" (UID: \"a8afe344-be23-4700-9ff6-95fa7d945bd8\") " pod="openshift-dns/node-resolver-z2rgw"
May 20 20:19:58.381610 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.381537    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8afe344-be23-4700-9ff6-95fa7d945bd8-tmp-dir\") pod \"node-resolver-z2rgw\" (UID: \"a8afe344-be23-4700-9ff6-95fa7d945bd8\") " pod="openshift-dns/node-resolver-z2rgw"
May 20 20:19:58.391082 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.391026    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m47d7\" (UniqueName: \"kubernetes.io/projected/a8afe344-be23-4700-9ff6-95fa7d945bd8-kube-api-access-m47d7\") pod \"node-resolver-z2rgw\" (UID: \"a8afe344-be23-4700-9ff6-95fa7d945bd8\") " pod="openshift-dns/node-resolver-z2rgw"
May 20 20:19:58.550279 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.549933    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z2rgw"
May 20 20:19:58.684570 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.684535    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:19:58.685120 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:58.684715    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:58.685120 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:58.684781    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs podName:b58b9421-7735-48d6-ae02-be449d7adfb9 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:02.684762679 +0000 UTC m=+9.131344877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs") pod "network-metrics-daemon-5rhth" (UID: "b58b9421-7735-48d6-ae02-be449d7adfb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:19:58.785887 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:58.785246    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7\") pod \"network-check-target-vhz52\" (UID: \"0a6c4f77-30a4-414a-8c74-5d627a46b507\") " pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:19:58.785887 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:58.785470    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:19:58.785887 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:58.785488    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:19:58.785887 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:58.785500    2575 projected.go:194] Error preparing data for projected volume kube-api-access-jkdn7 for pod openshift-network-diagnostics/network-check-target-vhz52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:58.785887 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:58.785552    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7 podName:0a6c4f77-30a4-414a-8c74-5d627a46b507 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:02.785535717 +0000 UTC m=+9.232117913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkdn7" (UniqueName: "kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7") pod "network-check-target-vhz52" (UID: "0a6c4f77-30a4-414a-8c74-5d627a46b507") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:19:59.089221 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:59.088631    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:59.089221 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:59.088810    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:19:59.089221 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:59.088870    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret podName:e02a3a83-a1de-4d01-b205-7fb737a4c5cc nodeName:}" failed. No retries permitted until 2026-05-20 20:20:03.088851518 +0000 UTC m=+9.535433729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret") pod "global-pull-secret-syncer-r2r4m" (UID: "e02a3a83-a1de-4d01-b205-7fb737a4c5cc") : object "kube-system"/"original-pull-secret" not registered
May 20 20:19:59.138887 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:59.138851    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:19:59.139096 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:59.138992    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:19:59.139182 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:59.139092    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:19:59.139182 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:19:59.139123    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:19:59.139322 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:59.139219    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:19:59.139322 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:19:59.139308    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:01.138446 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:01.138416    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:01.138896 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:01.138531    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:01.139122 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:01.138974    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:01.139122 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:01.139069    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:01.139122 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:01.139081    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:01.139399 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:01.139176    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:02.719520 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:02.719486    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:02.719891 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:02.719624    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:20:02.719891 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:02.719693    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs podName:b58b9421-7735-48d6-ae02-be449d7adfb9 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:10.719674555 +0000 UTC m=+17.166256754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs") pod "network-metrics-daemon-5rhth" (UID: "b58b9421-7735-48d6-ae02-be449d7adfb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:20:02.821129 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:02.820559    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7\") pod \"network-check-target-vhz52\" (UID: \"0a6c4f77-30a4-414a-8c74-5d627a46b507\") " pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:02.821129 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:02.820739    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:20:02.821129 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:02.820759    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:20:02.821129 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:02.820771    2575 projected.go:194] Error preparing data for projected volume kube-api-access-jkdn7 for pod openshift-network-diagnostics/network-check-target-vhz52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:20:02.821129 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:02.820824    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7 podName:0a6c4f77-30a4-414a-8c74-5d627a46b507 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:10.820810194 +0000 UTC m=+17.267392389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkdn7" (UniqueName: "kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7") pod "network-check-target-vhz52" (UID: "0a6c4f77-30a4-414a-8c74-5d627a46b507") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:20:03.123586 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:03.123482    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:03.123744 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:03.123660    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:20:03.123744 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:03.123735    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret podName:e02a3a83-a1de-4d01-b205-7fb737a4c5cc nodeName:}" failed. No retries permitted until 2026-05-20 20:20:11.123715127 +0000 UTC m=+17.570297530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret") pod "global-pull-secret-syncer-r2r4m" (UID: "e02a3a83-a1de-4d01-b205-7fb737a4c5cc") : object "kube-system"/"original-pull-secret" not registered
May 20 20:20:03.138649 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:03.138622    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:03.138792 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:03.138750    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:03.138792 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:03.138771    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:03.138904 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:03.138855    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:03.138904 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:03.138894    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:03.139004 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:03.138979    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:05.139355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:05.139140    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:05.139785 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:05.139140    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:05.139785 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:05.139441    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:05.139785 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:05.139144    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:05.139785 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:05.139522    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:05.139785 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:05.139619    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:07.138533 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:07.138499    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:07.138957 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:07.138499    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:07.138957 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:07.138616    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:07.138957 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:07.138709    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:07.138957 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:07.138499    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:07.138957 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:07.138817    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:09.138321 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:09.138287    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:09.138755 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:09.138287    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:09.138755 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:09.138399    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:09.138755 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:09.138408    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:09.138755 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:09.138486    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:09.138755 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:09.138553    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:10.781891 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:10.781858    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:10.782383 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:10.782018    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:20:10.782383 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:10.782086    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs podName:b58b9421-7735-48d6-ae02-be449d7adfb9 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:26.782067432 +0000 UTC m=+33.228649639 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs") pod "network-metrics-daemon-5rhth" (UID: "b58b9421-7735-48d6-ae02-be449d7adfb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:20:10.883084 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:10.883051    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7\") pod \"network-check-target-vhz52\" (UID: \"0a6c4f77-30a4-414a-8c74-5d627a46b507\") " pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:10.883250 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:10.883174    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:20:10.883250 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:10.883200    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:20:10.883250 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:10.883210    2575 projected.go:194] Error preparing data for projected volume kube-api-access-jkdn7 for pod openshift-network-diagnostics/network-check-target-vhz52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:20:10.883381 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:10.883259    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7 podName:0a6c4f77-30a4-414a-8c74-5d627a46b507 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:26.883241923 +0000 UTC m=+33.329824134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkdn7" (UniqueName: "kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7") pod "network-check-target-vhz52" (UID: "0a6c4f77-30a4-414a-8c74-5d627a46b507") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:20:11.138796 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:11.138761    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:11.138796 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:11.138789    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:11.139028 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:11.138761    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:11.139028 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:11.138893    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:11.139028 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:11.138997    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:11.139160 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:11.139089    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:11.185632 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:11.185597    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:11.185784 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:11.185764    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 20:20:11.185848 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:11.185837    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret podName:e02a3a83-a1de-4d01-b205-7fb737a4c5cc nodeName:}" failed. No retries permitted until 2026-05-20 20:20:27.185821999 +0000 UTC m=+33.632404201 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret") pod "global-pull-secret-syncer-r2r4m" (UID: "e02a3a83-a1de-4d01-b205-7fb737a4c5cc") : object "kube-system"/"original-pull-secret" not registered
May 20 20:20:13.139116 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:13.139081    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:13.139527 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:13.139078    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:13.139527 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:13.139208    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:13.139527 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:13.139080    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:13.139527 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:13.139294    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:13.139527 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:13.139398    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:13.944497 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:20:13.944470    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8afe344_be23_4700_9ff6_95fa7d945bd8.slice/crio-f93c3e05b6de372bc2ab5b26f9aa77339a1d83800b117dae3626e4cd9b742eb4 WatchSource:0}: Error finding container f93c3e05b6de372bc2ab5b26f9aa77339a1d83800b117dae3626e4cd9b742eb4: Status 404 returned error can't find the container with id f93c3e05b6de372bc2ab5b26f9aa77339a1d83800b117dae3626e4cd9b742eb4
May 20 20:20:14.266685 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:14.266653    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wkv7z" event={"ID":"cf65f086-d86f-4332-9ea5-89a74e7ce9e3","Type":"ContainerStarted","Data":"df07e07c359aa56fe14f369a1199c2fe38793b883eccdd3100070bb17b8c2031"}
May 20 20:20:14.269322 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:14.269296    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal" event={"ID":"742e74dfb476718f2640591828e6c470","Type":"ContainerStarted","Data":"efbc2312b2340c5fc088a73e33cf9a05ac120c74bfe2cc2c307fd2e4c5c2e3ef"}
May 20 20:20:14.270667 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:14.270627    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z2rgw" event={"ID":"a8afe344-be23-4700-9ff6-95fa7d945bd8","Type":"ContainerStarted","Data":"f93c3e05b6de372bc2ab5b26f9aa77339a1d83800b117dae3626e4cd9b742eb4"}
May 20 20:20:14.272520 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:14.272484    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" event={"ID":"59f569cb-5ecd-41a0-8d28-5cc6a76211af","Type":"ContainerStarted","Data":"1d6a225e0da2c83f3cd3cf85d94a1a829838ae49222e54fca71139efb1db80c2"}
May 20 20:20:14.272520 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:14.272513    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" event={"ID":"59f569cb-5ecd-41a0-8d28-5cc6a76211af","Type":"ContainerStarted","Data":"44d3ae88ee416796a3743561674e5b4de7b5520501dfb810c7e3556b16d4226f"}
May 20 20:20:14.308937 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:14.308599    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-220.ec2.internal" podStartSLOduration=20.308579345 podStartE2EDuration="20.308579345s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:20:14.307498927 +0000 UTC m=+20.754081156" watchObservedRunningTime="2026-05-20 20:20:14.308579345 +0000 UTC m=+20.755161563"
May 20 20:20:14.312615 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:14.311158    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wkv7z" podStartSLOduration=1.7350986320000001 podStartE2EDuration="20.311141406s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="2026-05-20 20:19:55.368538568 +0000 UTC m=+1.815120767" lastFinishedPulling="2026-05-20 20:20:13.944581343 +0000 UTC m=+20.391163541" observedRunningTime="2026-05-20 20:20:14.29032441 +0000 UTC m=+20.736906627" watchObservedRunningTime="2026-05-20 20:20:14.311141406 +0000 UTC m=+20.757723625"
May 20 20:20:15.138626 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.138414    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:15.138807 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.138414    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:15.138807 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:15.138726    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:15.138807 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.138473    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:15.138952 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:15.138828    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:15.138952 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:15.138891    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:15.276314 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.276217    2575 generic.go:358] "Generic (PLEG): container finished" podID="fcaf49d3bd9983480bea8efd144c48e3" containerID="2ce6915b247f02eff9527cda965c98cdb57f68a1b6956cb4ca89b5fd80d906e2" exitCode=0
May 20 20:20:15.277101 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.276311    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal" event={"ID":"fcaf49d3bd9983480bea8efd144c48e3","Type":"ContainerDied","Data":"2ce6915b247f02eff9527cda965c98cdb57f68a1b6956cb4ca89b5fd80d906e2"}
May 20 20:20:15.277917 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.277890    2575 generic.go:358] "Generic (PLEG): container finished" podID="f2070d17-2dcd-4182-8d03-ca05d20ac2c9" containerID="34b8d352ac53fc805d61b0d9c77a2459cd7b61faf82737e7e0d66dce43a92924" exitCode=0
May 20 20:20:15.278033 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.277969    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lhpb" event={"ID":"f2070d17-2dcd-4182-8d03-ca05d20ac2c9","Type":"ContainerDied","Data":"34b8d352ac53fc805d61b0d9c77a2459cd7b61faf82737e7e0d66dce43a92924"}
May 20 20:20:15.279394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.279367    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr" event={"ID":"1728d36a-b398-46f8-852f-dc4bdca06ac1","Type":"ContainerStarted","Data":"bc459f9c59da12e580a3aa7c6e7b32cae47b783489d3337a7bccb0f4673a67ed"}
May 20 20:20:15.280730 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.280697    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jzhww" event={"ID":"1024ee22-2e8f-410b-be16-302ef6e7b0eb","Type":"ContainerStarted","Data":"3a6b3e0116ee81bc34471fdb9fa20fe43bdbba4c98dedace518f68d9bdc11fec"}
May 20 20:20:15.282016 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.281997    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j78m7" event={"ID":"55c4fdfe-baec-4dad-ac0c-82e45752d1b7","Type":"ContainerStarted","Data":"e07fafd2fb8789fac921f9c49b29e28c6c42d852883888ca079cb6aae9219d1c"}
May 20 20:20:15.283309 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.283289    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z2rgw" event={"ID":"a8afe344-be23-4700-9ff6-95fa7d945bd8","Type":"ContainerStarted","Data":"b66bf6f275f09c7cf5099d1eb5617d535ea6bd3670f9533e3d459a1669db6931"}
May 20 20:20:15.284993 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.284969    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dbzh4" event={"ID":"159c1ebf-42c3-4fe7-b624-208c0435814d","Type":"ContainerStarted","Data":"bef059e8a5d90a99641f56a61c43de19dec2af022b937635301b181e12da54bb"}
May 20 20:20:15.287314 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.287299    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:20:15.287681 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.287657    2575 generic.go:358] "Generic (PLEG): container finished" podID="59f569cb-5ecd-41a0-8d28-5cc6a76211af" containerID="1d6a225e0da2c83f3cd3cf85d94a1a829838ae49222e54fca71139efb1db80c2" exitCode=1
May 20 20:20:15.287746 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.287725    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" event={"ID":"59f569cb-5ecd-41a0-8d28-5cc6a76211af","Type":"ContainerDied","Data":"1d6a225e0da2c83f3cd3cf85d94a1a829838ae49222e54fca71139efb1db80c2"}
May 20 20:20:15.287786 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.287750    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" event={"ID":"59f569cb-5ecd-41a0-8d28-5cc6a76211af","Type":"ContainerStarted","Data":"d1da20babb05f1e1a612d880fd656cad95d4d1ce838cae4cdbca9b0737af73f9"}
May 20 20:20:15.287786 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.287764    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" event={"ID":"59f569cb-5ecd-41a0-8d28-5cc6a76211af","Type":"ContainerStarted","Data":"f178cc60d4e4020e1264b3d6439b8679f9e9783be469568d1ac922753fc5da9d"}
May 20 20:20:15.287786 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.287776    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" event={"ID":"59f569cb-5ecd-41a0-8d28-5cc6a76211af","Type":"ContainerStarted","Data":"97abc6d1a9bdda83ff63fa64174227ad2dd047321d34d028c7d9598eda6ca64c"}
May 20 20:20:15.287896 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.287789    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" event={"ID":"59f569cb-5ecd-41a0-8d28-5cc6a76211af","Type":"ContainerStarted","Data":"f094b8ebd76e9d6c24781f61378347b6b955cfd81858a80d9d75f6e6179e119f"}
May 20 20:20:15.337590 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.337545    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dbzh4" podStartSLOduration=2.910553354 podStartE2EDuration="21.337529535s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="2026-05-20 20:19:55.45061064 +0000 UTC m=+1.897192834" lastFinishedPulling="2026-05-20 20:20:13.877586818 +0000 UTC m=+20.324169015" observedRunningTime="2026-05-20 20:20:15.314752432 +0000 UTC m=+21.761334648" watchObservedRunningTime="2026-05-20 20:20:15.337529535 +0000 UTC m=+21.784111783"
May 20 20:20:15.356686 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.356646    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-j78m7" podStartSLOduration=2.515031699 podStartE2EDuration="21.356632806s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="2026-05-20 20:19:55.384917647 +0000 UTC m=+1.831499841" lastFinishedPulling="2026-05-20 20:20:14.226518736 +0000 UTC m=+20.673100948" observedRunningTime="2026-05-20 20:20:15.356326005 +0000 UTC m=+21.802908213" watchObservedRunningTime="2026-05-20 20:20:15.356632806 +0000 UTC m=+21.803215020"
May 20 20:20:15.372677 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.372638    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jzhww" podStartSLOduration=6.677070307 podStartE2EDuration="21.372624401s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="2026-05-20 20:19:55.427528492 +0000 UTC m=+1.874110687" lastFinishedPulling="2026-05-20 20:20:10.123082586 +0000 UTC m=+16.569664781" observedRunningTime="2026-05-20 20:20:15.372402451 +0000 UTC m=+21.818984669" watchObservedRunningTime="2026-05-20 20:20:15.372624401 +0000 UTC m=+21.819206618"
May 20 20:20:15.389625 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.389577    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-z2rgw" podStartSLOduration=17.389557428 podStartE2EDuration="17.389557428s" podCreationTimestamp="2026-05-20 20:19:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:20:15.388633158 +0000 UTC m=+21.835215377" watchObservedRunningTime="2026-05-20 20:20:15.389557428 +0000 UTC m=+21.836139644"
May 20 20:20:15.469580 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:15.469553    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 20 20:20:16.123498 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:16.123376    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T20:20:15.469574805Z","UUID":"fdf83dfd-eb58-4a2b-a305-21aa95d5faea","Handler":null,"Name":"","Endpoint":""}
May 20 20:20:16.126752 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:16.126723    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 20 20:20:16.126752 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:16.126753    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 20 20:20:16.290971 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:16.290935    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wtbg9" event={"ID":"ea70fe5f-f8d3-4ea1-acd8-9b68c36bd5a5","Type":"ContainerStarted","Data":"f1790bcf4b2dd56798d05a6c3f9255e2b6c39785c012b9807cfbc8d762e64e69"}
May 20 20:20:16.292817 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:16.292796    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal" event={"ID":"fcaf49d3bd9983480bea8efd144c48e3","Type":"ContainerStarted","Data":"3cb2bd4ed52a05516bdc0292e7005bb6fe1d58789e39875edabf32c8fba64f0c"}
May 20 20:20:16.294392 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:16.294337    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr" event={"ID":"1728d36a-b398-46f8-852f-dc4bdca06ac1","Type":"ContainerStarted","Data":"408364015e340a55c8c94413efefe8b4f7423f92c9b55c2b27e93594eb7aeb11"}
May 20 20:20:16.307955 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:16.307907    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wtbg9" podStartSLOduration=4.202816195 podStartE2EDuration="22.307890897s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="2026-05-20 20:19:55.402946694 +0000 UTC m=+1.849528888" lastFinishedPulling="2026-05-20 20:20:13.508021382 +0000 UTC m=+19.954603590" observedRunningTime="2026-05-20 20:20:16.307310562 +0000 UTC m=+22.753892778" watchObservedRunningTime="2026-05-20 20:20:16.307890897 +0000 UTC m=+22.754473121"
May 20 20:20:16.327710 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:16.327663    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-220.ec2.internal" podStartSLOduration=22.327648871 podStartE2EDuration="22.327648871s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:20:16.327022661 +0000 UTC m=+22.773604877" watchObservedRunningTime="2026-05-20 20:20:16.327648871 +0000 UTC m=+22.774231087"
May 20 20:20:17.139186 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:17.139155    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:17.139422 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:17.139155    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:17.139422 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:17.139278    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:17.139422 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:17.139155    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:17.139422 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:17.139350    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:17.139637 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:17.139457    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:17.297983 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:17.297943    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr" event={"ID":"1728d36a-b398-46f8-852f-dc4bdca06ac1","Type":"ContainerStarted","Data":"63b693634c5697203e01e17f07d26fceca5aeb4a7084caf9e4790ff7ed89cde7"}
May 20 20:20:17.301385 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:17.301143    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:20:17.302821 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:17.302778    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" event={"ID":"59f569cb-5ecd-41a0-8d28-5cc6a76211af","Type":"ContainerStarted","Data":"d01e8a3ec4742ebdcce480bdf1a4d13db25482b0d15542ab07174412ab183ef4"}
May 20 20:20:17.321017 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:17.320967    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sfdr" podStartSLOduration=2.368551449 podStartE2EDuration="23.32095284s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="2026-05-20 20:19:55.442954376 +0000 UTC m=+1.889536571" lastFinishedPulling="2026-05-20 20:20:16.39535576 +0000 UTC m=+22.841937962" observedRunningTime="2026-05-20 20:20:17.32027258 +0000 UTC m=+23.766854799" watchObservedRunningTime="2026-05-20 20:20:17.32095284 +0000 UTC m=+23.767535067"
May 20 20:20:18.281734 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:18.281535    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jzhww"
May 20 20:20:18.282222 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:18.282185    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jzhww"
May 20 20:20:18.304140 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:18.304103    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jzhww"
May 20 20:20:18.304743 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:18.304727    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jzhww"
May 20 20:20:19.139252 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:19.139218    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:19.139434 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:19.139218    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:19.139434 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:19.139350    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:19.139434 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:19.139348    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:19.139591 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:19.139445    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:19.139591 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:19.139531    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:20.310054 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:20.309885    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:20:20.310937 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:20.310383    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" event={"ID":"59f569cb-5ecd-41a0-8d28-5cc6a76211af","Type":"ContainerStarted","Data":"ea20872747e08d4c80238bcabaf21081229077b5173f4db7336c4c57c703adfb"}
May 20 20:20:20.310937 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:20.310753    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:20:20.310937 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:20.310775    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:20:20.311107 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:20.311049    2575 scope.go:117] "RemoveContainer" containerID="1d6a225e0da2c83f3cd3cf85d94a1a829838ae49222e54fca71139efb1db80c2"
May 20 20:20:20.312179 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:20.312151    2575 generic.go:358] "Generic (PLEG): container finished" podID="f2070d17-2dcd-4182-8d03-ca05d20ac2c9" containerID="57fc54bb1dbc26919bf35b6c79d004ef1eddcdc62188f29f2959f1d4e22c8a03" exitCode=0
May 20 20:20:20.312300 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:20.312223    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lhpb" event={"ID":"f2070d17-2dcd-4182-8d03-ca05d20ac2c9","Type":"ContainerDied","Data":"57fc54bb1dbc26919bf35b6c79d004ef1eddcdc62188f29f2959f1d4e22c8a03"}
May 20 20:20:20.327515 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:20.327495    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:20:21.138532 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.138507    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:21.138698 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.138507    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:21.138698 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:21.138614    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:21.138799 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:21.138724    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:21.138799 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.138507    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:21.138898 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:21.138817    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:21.315400 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.315369    2575 generic.go:358] "Generic (PLEG): container finished" podID="f2070d17-2dcd-4182-8d03-ca05d20ac2c9" containerID="9226e131d242d6ff19e90de8b3fe6311916d832e263a7ae0efdec668eaf8999f" exitCode=0
May 20 20:20:21.315759 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.315451    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lhpb" event={"ID":"f2070d17-2dcd-4182-8d03-ca05d20ac2c9","Type":"ContainerDied","Data":"9226e131d242d6ff19e90de8b3fe6311916d832e263a7ae0efdec668eaf8999f"}
May 20 20:20:21.318732 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.318713    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:20:21.319030 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.319007    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" event={"ID":"59f569cb-5ecd-41a0-8d28-5cc6a76211af","Type":"ContainerStarted","Data":"28e8937397487e99138f295e55da41c526302643f4ac5fa12482186020c93efe"}
May 20 20:20:21.319390 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.319323    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:20:21.337056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.336984    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r2r4m"]
May 20 20:20:21.337214 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.337101    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:21.337280 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:21.337226    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:21.338003 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.337971    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:20:21.342528 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.342503    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rhth"]
May 20 20:20:21.342667 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.342615    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:21.342915 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:21.342763    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:21.347000 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.344429    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vhz52"]
May 20 20:20:21.347000 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.344611    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:21.347000 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:21.344729    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:21.389675 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:21.389627    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj" podStartSLOduration=8.859403757 podStartE2EDuration="27.389612695s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="2026-05-20 20:19:55.413216894 +0000 UTC m=+1.859799088" lastFinishedPulling="2026-05-20 20:20:13.943425817 +0000 UTC m=+20.390008026" observedRunningTime="2026-05-20 20:20:21.389229908 +0000 UTC m=+27.835812126" watchObservedRunningTime="2026-05-20 20:20:21.389612695 +0000 UTC m=+27.836194910"
May 20 20:20:22.322545 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:22.322501    2575 generic.go:358] "Generic (PLEG): container finished" podID="f2070d17-2dcd-4182-8d03-ca05d20ac2c9" containerID="2fb1f1437aca870d548c511f20848f43db288412827d1f758b49f07dc3d4c580" exitCode=0
May 20 20:20:22.322903 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:22.322544    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lhpb" event={"ID":"f2070d17-2dcd-4182-8d03-ca05d20ac2c9","Type":"ContainerDied","Data":"2fb1f1437aca870d548c511f20848f43db288412827d1f758b49f07dc3d4c580"}
May 20 20:20:23.138651 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:23.138466    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:23.138825 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:23.138466    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:23.138825 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:23.138735    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:23.138947 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:23.138821    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:23.138947 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:23.138482    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:23.138947 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:23.138935    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:25.138853 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:25.138817    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:25.139336 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:25.138817    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:25.139336 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:25.138934    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:20:25.139336 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:25.138817    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:25.139336 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:25.139012    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhz52" podUID="0a6c4f77-30a4-414a-8c74-5d627a46b507"
May 20 20:20:25.139336 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:25.139115    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r2r4m" podUID="e02a3a83-a1de-4d01-b205-7fb737a4c5cc"
May 20 20:20:26.800869 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.800828    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:26.801574 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:26.800976    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:20:26.801574 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:26.801039    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs podName:b58b9421-7735-48d6-ae02-be449d7adfb9 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:58.801021239 +0000 UTC m=+65.247603437 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs") pod "network-metrics-daemon-5rhth" (UID: "b58b9421-7735-48d6-ae02-be449d7adfb9") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 20:20:26.831016 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.830992    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-220.ec2.internal" event="NodeReady"
May 20 20:20:26.831163 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.831117    2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 20 20:20:26.868977 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.868936    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-665b844584-vfxnf"]
May 20 20:20:26.901385 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.901356    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7\") pod \"network-check-target-vhz52\" (UID: \"0a6c4f77-30a4-414a-8c74-5d627a46b507\") " pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:26.901560 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:26.901539    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 20:20:26.901628 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:26.901570    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 20:20:26.901628 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:26.901584    2575 projected.go:194] Error preparing data for projected volume kube-api-access-jkdn7 for pod openshift-network-diagnostics/network-check-target-vhz52: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:20:26.901726 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:26.901654    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7 podName:0a6c4f77-30a4-414a-8c74-5d627a46b507 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:58.90163514 +0000 UTC m=+65.348217348 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkdn7" (UniqueName: "kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7") pod "network-check-target-vhz52" (UID: "0a6c4f77-30a4-414a-8c74-5d627a46b507") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 20:20:26.903914 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.903888    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8w2r7"]
May 20 20:20:26.904083 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.904046    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:26.906969 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.906944    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 20 20:20:26.907080 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.906998    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lck56\""
May 20 20:20:26.907080 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.907020    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 20 20:20:26.907361 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.907344    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 20 20:20:26.913462 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.913444    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 20 20:20:26.920414 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.920384    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-288pq"]
May 20 20:20:26.920514 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.920447    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:26.922738 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.922721    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 20 20:20:26.922852 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.922837    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 20 20:20:26.922940 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.922927    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8wmjb\""
May 20 20:20:26.934074 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.934051    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-665b844584-vfxnf"]
May 20 20:20:26.934165 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.934080    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8w2r7"]
May 20 20:20:26.934165 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.934095    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-288pq"]
May 20 20:20:26.934292 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.934222    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:26.936559 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.936538    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 20 20:20:26.936643 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.936564    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 20 20:20:26.936643 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.936543    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 20 20:20:26.936894 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:26.936876    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6s6vr\""
May 20 20:20:27.002361 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8zlm\" (UniqueName: \"kubernetes.io/projected/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-kube-api-access-t8zlm\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.002361 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-installation-pull-secrets\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.002361 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-config-volume\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.002620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-924qr\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-kube-api-access-924qr\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.002620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002408    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-image-registry-private-configuration\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.002620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31d264fc-b175-4c94-99e6-17b75a5ac450-ca-trust-extracted\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.002620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.002620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-trusted-ca\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.002620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002494    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.002620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-certificates\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.002620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-bound-sa-token\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.002620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.002608    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-tmp-dir\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.103817 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.103758    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-924qr\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-kube-api-access-924qr\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.103996 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.103909    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-image-registry-private-configuration\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.103996 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.103942    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31d264fc-b175-4c94-99e6-17b75a5ac450-ca-trust-extracted\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.103996 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.103975    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.104179 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.103999    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-trusted-ca\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.104179 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104033    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.104179 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104100    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-certificates\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.104179 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc9lj\" (UniqueName: \"kubernetes.io/projected/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-kube-api-access-dc9lj\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:27.104179 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104162    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-bound-sa-token\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.104458 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.104176    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:27.104458 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104203    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-tmp-dir\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.104458 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.104213    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665b844584-vfxnf: secret "image-registry-tls" not found
May 20 20:20:27.104458 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:27.104458 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.104270    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:27.104458 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.104277    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls podName:31d264fc-b175-4c94-99e6-17b75a5ac450 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:27.60425262 +0000 UTC m=+34.050834828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls") pod "image-registry-665b844584-vfxnf" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450") : secret "image-registry-tls" not found
May 20 20:20:27.104458 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.104358    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls podName:c12b8325-2b1d-4837-9d3d-7df8fb7b4f58 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:27.604339729 +0000 UTC m=+34.050921943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls") pod "dns-default-8w2r7" (UID: "c12b8325-2b1d-4837-9d3d-7df8fb7b4f58") : secret "dns-default-metrics-tls" not found
May 20 20:20:27.104458 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104405    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8zlm\" (UniqueName: \"kubernetes.io/projected/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-kube-api-access-t8zlm\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.104458 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104442    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31d264fc-b175-4c94-99e6-17b75a5ac450-ca-trust-extracted\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.104458 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104459    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-installation-pull-secrets\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.104958 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104498    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-config-volume\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.104958 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104648    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-certificates\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.104958 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.104894    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-tmp-dir\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.105079 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.105037    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-config-volume\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.105531 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.105359    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-trusted-ca\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.108553 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.108534    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-image-registry-private-configuration\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.108645 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.108588    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-installation-pull-secrets\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.116002 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.115977    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-bound-sa-token\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.116156 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.116103    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8zlm\" (UniqueName: \"kubernetes.io/projected/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-kube-api-access-t8zlm\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.116550 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.116522    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-924qr\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-kube-api-access-924qr\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.138293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.138262    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:27.138419 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.138262    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:27.138482 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.138266    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:27.140738 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.140718    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qsfbr\""
May 20 20:20:27.140876 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.140860    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 20:20:27.140949 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.140878    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 20:20:27.141326 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.141304    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 20:20:27.141496 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.141476    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 20:20:27.142435 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.141917    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5c2rk\""
May 20 20:20:27.205822 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.205786    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:27.205822 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.205823    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dc9lj\" (UniqueName: \"kubernetes.io/projected/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-kube-api-access-dc9lj\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:27.206039 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.205850    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:27.206039 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.205963    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:27.206039 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.206028    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert podName:15c1ec37-1eb0-4805-9fb4-f651bb85f3d0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:27.706014444 +0000 UTC m=+34.152596651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert") pod "ingress-canary-288pq" (UID: "15c1ec37-1eb0-4805-9fb4-f651bb85f3d0") : secret "canary-serving-cert" not found
May 20 20:20:27.208453 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.208430    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e02a3a83-a1de-4d01-b205-7fb737a4c5cc-original-pull-secret\") pod \"global-pull-secret-syncer-r2r4m\" (UID: \"e02a3a83-a1de-4d01-b205-7fb737a4c5cc\") " pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:27.215032 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.215011    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc9lj\" (UniqueName: \"kubernetes.io/projected/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-kube-api-access-dc9lj\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:27.452207 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.452157    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r2r4m"
May 20 20:20:27.610091 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.610052    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:27.610288 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.610100    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:27.610288 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.610245    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:27.610288 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.610266    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665b844584-vfxnf: secret "image-registry-tls" not found
May 20 20:20:27.610288 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.610268    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:27.610431 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.610336    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls podName:31d264fc-b175-4c94-99e6-17b75a5ac450 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:28.610317056 +0000 UTC m=+35.056899264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls") pod "image-registry-665b844584-vfxnf" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450") : secret "image-registry-tls" not found
May 20 20:20:27.610431 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.610353    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls podName:c12b8325-2b1d-4837-9d3d-7df8fb7b4f58 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:28.610344282 +0000 UTC m=+35.056926480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls") pod "dns-default-8w2r7" (UID: "c12b8325-2b1d-4837-9d3d-7df8fb7b4f58") : secret "dns-default-metrics-tls" not found
May 20 20:20:27.710867 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.710797    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:27.710983 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.710908    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:27.710983 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:27.710958    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert podName:15c1ec37-1eb0-4805-9fb4-f651bb85f3d0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:28.710944825 +0000 UTC m=+35.157527019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert") pod "ingress-canary-288pq" (UID: "15c1ec37-1eb0-4805-9fb4-f651bb85f3d0") : secret "canary-serving-cert" not found
May 20 20:20:27.857815 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:27.857591    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r2r4m"]
May 20 20:20:27.979976 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:20:27.979873    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02a3a83_a1de_4d01_b205_7fb737a4c5cc.slice/crio-bc59bf2285d919a7f689b88896d9860365453c038893bc422584b23adec8db97 WatchSource:0}: Error finding container bc59bf2285d919a7f689b88896d9860365453c038893bc422584b23adec8db97: Status 404 returned error can't find the container with id bc59bf2285d919a7f689b88896d9860365453c038893bc422584b23adec8db97
May 20 20:20:28.337136 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:28.337101    2575 generic.go:358] "Generic (PLEG): container finished" podID="f2070d17-2dcd-4182-8d03-ca05d20ac2c9" containerID="650a0b962a3a54c13f94d45cb783e13d223ea4af79a25072e4882f0880fbb7e1" exitCode=0
May 20 20:20:28.337278 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:28.337182    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lhpb" event={"ID":"f2070d17-2dcd-4182-8d03-ca05d20ac2c9","Type":"ContainerDied","Data":"650a0b962a3a54c13f94d45cb783e13d223ea4af79a25072e4882f0880fbb7e1"}
May 20 20:20:28.338096 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:28.338078    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r2r4m" event={"ID":"e02a3a83-a1de-4d01-b205-7fb737a4c5cc","Type":"ContainerStarted","Data":"bc59bf2285d919a7f689b88896d9860365453c038893bc422584b23adec8db97"}
May 20 20:20:28.618993 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:28.618961    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:28.619169 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:28.618998    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:28.619169 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:28.619127    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:28.619296 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:28.619185    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls podName:c12b8325-2b1d-4837-9d3d-7df8fb7b4f58 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:30.619166426 +0000 UTC m=+37.065748642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls") pod "dns-default-8w2r7" (UID: "c12b8325-2b1d-4837-9d3d-7df8fb7b4f58") : secret "dns-default-metrics-tls" not found
May 20 20:20:28.619296 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:28.619215    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:28.619296 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:28.619237    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665b844584-vfxnf: secret "image-registry-tls" not found
May 20 20:20:28.619438 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:28.619309    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls podName:31d264fc-b175-4c94-99e6-17b75a5ac450 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:30.619291976 +0000 UTC m=+37.065874189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls") pod "image-registry-665b844584-vfxnf" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450") : secret "image-registry-tls" not found
May 20 20:20:28.719891 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:28.719858    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:28.720090 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:28.719969    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:28.720090 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:28.720041    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert podName:15c1ec37-1eb0-4805-9fb4-f651bb85f3d0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:30.720016521 +0000 UTC m=+37.166598734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert") pod "ingress-canary-288pq" (UID: "15c1ec37-1eb0-4805-9fb4-f651bb85f3d0") : secret "canary-serving-cert" not found
May 20 20:20:29.343643 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:29.343604    2575 generic.go:358] "Generic (PLEG): container finished" podID="f2070d17-2dcd-4182-8d03-ca05d20ac2c9" containerID="54304bef7e8d98eeb533aab006b0806d573b158c84b9ef7706203fbb63b42a9e" exitCode=0
May 20 20:20:29.344074 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:29.343664    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lhpb" event={"ID":"f2070d17-2dcd-4182-8d03-ca05d20ac2c9","Type":"ContainerDied","Data":"54304bef7e8d98eeb533aab006b0806d573b158c84b9ef7706203fbb63b42a9e"}
May 20 20:20:30.348849 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:30.348806    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lhpb" event={"ID":"f2070d17-2dcd-4182-8d03-ca05d20ac2c9","Type":"ContainerStarted","Data":"85d2d36a9acbb5bf73234cb93b4df1e8c27e5a3b78e8880573adf301401c4fa9"}
May 20 20:20:30.371783 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:30.371724    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6lhpb" podStartSLOduration=3.8088065330000003 podStartE2EDuration="36.371708218s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="2026-05-20 20:19:55.455370978 +0000 UTC m=+1.901953172" lastFinishedPulling="2026-05-20 20:20:28.01827266 +0000 UTC m=+34.464854857" observedRunningTime="2026-05-20 20:20:30.3701223 +0000 UTC m=+36.816704516" watchObservedRunningTime="2026-05-20 20:20:30.371708218 +0000 UTC m=+36.818290433"
May 20 20:20:30.635681 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:30.635643    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:30.635681 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:30.635684    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:30.635897 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:30.635800    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:30.635897 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:30.635825    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665b844584-vfxnf: secret "image-registry-tls" not found
May 20 20:20:30.635897 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:30.635839    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:30.635897 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:30.635893    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls podName:31d264fc-b175-4c94-99e6-17b75a5ac450 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:34.635872703 +0000 UTC m=+41.082454901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls") pod "image-registry-665b844584-vfxnf" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450") : secret "image-registry-tls" not found
May 20 20:20:30.636047 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:30.635912    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls podName:c12b8325-2b1d-4837-9d3d-7df8fb7b4f58 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:34.635903011 +0000 UTC m=+41.082485212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls") pod "dns-default-8w2r7" (UID: "c12b8325-2b1d-4837-9d3d-7df8fb7b4f58") : secret "dns-default-metrics-tls" not found
May 20 20:20:30.736575 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:30.736534    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:30.736757 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:30.736667    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:30.736757 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:30.736736    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert podName:15c1ec37-1eb0-4805-9fb4-f651bb85f3d0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:34.736718131 +0000 UTC m=+41.183300340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert") pod "ingress-canary-288pq" (UID: "15c1ec37-1eb0-4805-9fb4-f651bb85f3d0") : secret "canary-serving-cert" not found
May 20 20:20:32.353717 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:32.353682    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r2r4m" event={"ID":"e02a3a83-a1de-4d01-b205-7fb737a4c5cc","Type":"ContainerStarted","Data":"d02bcdecf8b2876b13d8b0fd464ff573544d383b18c6e4c78997cfcc5a35d0cb"}
May 20 20:20:32.368529 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:32.368488    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r2r4m" podStartSLOduration=33.707174734 podStartE2EDuration="37.368474624s" podCreationTimestamp="2026-05-20 20:19:55 +0000 UTC" firstStartedPulling="2026-05-20 20:20:27.996968844 +0000 UTC m=+34.443551039" lastFinishedPulling="2026-05-20 20:20:31.658268724 +0000 UTC m=+38.104850929" observedRunningTime="2026-05-20 20:20:32.368080382 +0000 UTC m=+38.814662594" watchObservedRunningTime="2026-05-20 20:20:32.368474624 +0000 UTC m=+38.815056841"
May 20 20:20:34.664476 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:34.664439    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:34.664476 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:34.664485    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:34.665003 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:34.664600    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:34.665003 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:34.664680    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls podName:c12b8325-2b1d-4837-9d3d-7df8fb7b4f58 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:42.664659385 +0000 UTC m=+49.111241601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls") pod "dns-default-8w2r7" (UID: "c12b8325-2b1d-4837-9d3d-7df8fb7b4f58") : secret "dns-default-metrics-tls" not found
May 20 20:20:34.665003 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:34.664713    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:34.665003 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:34.664738    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665b844584-vfxnf: secret "image-registry-tls" not found
May 20 20:20:34.665003 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:34.664794    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls podName:31d264fc-b175-4c94-99e6-17b75a5ac450 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:42.664779329 +0000 UTC m=+49.111361525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls") pod "image-registry-665b844584-vfxnf" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450") : secret "image-registry-tls" not found
May 20 20:20:34.765863 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:34.765824    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:34.766020 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:34.765928    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:34.766020 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:34.765985    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert podName:15c1ec37-1eb0-4805-9fb4-f651bb85f3d0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:42.765972743 +0000 UTC m=+49.212554937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert") pod "ingress-canary-288pq" (UID: "15c1ec37-1eb0-4805-9fb4-f651bb85f3d0") : secret "canary-serving-cert" not found
May 20 20:20:42.724861 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:42.724823    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:42.724861 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:42.724861    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:42.725287 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:42.724966    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:42.725287 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:42.724972    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:42.725287 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:42.724991    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665b844584-vfxnf: secret "image-registry-tls" not found
May 20 20:20:42.725287 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:42.725029    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls podName:c12b8325-2b1d-4837-9d3d-7df8fb7b4f58 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:58.725014843 +0000 UTC m=+65.171597038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls") pod "dns-default-8w2r7" (UID: "c12b8325-2b1d-4837-9d3d-7df8fb7b4f58") : secret "dns-default-metrics-tls" not found
May 20 20:20:42.725287 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:42.725042    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls podName:31d264fc-b175-4c94-99e6-17b75a5ac450 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:58.725036315 +0000 UTC m=+65.171618510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls") pod "image-registry-665b844584-vfxnf" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450") : secret "image-registry-tls" not found
May 20 20:20:42.826183 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:42.826148    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:42.826388 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:42.826278    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:42.826388 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:42.826346    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert podName:15c1ec37-1eb0-4805-9fb4-f651bb85f3d0 nodeName:}" failed. No retries permitted until 2026-05-20 20:20:58.826326795 +0000 UTC m=+65.272908989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert") pod "ingress-canary-288pq" (UID: "15c1ec37-1eb0-4805-9fb4-f651bb85f3d0") : secret "canary-serving-cert" not found
May 20 20:20:53.335340 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:53.335311    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kdcdj"
May 20 20:20:58.086359 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.086323    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk"]
May 20 20:20:58.089255 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.089234    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk"
May 20 20:20:58.093593 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.093573    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 20 20:20:58.093719 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.093600    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5k9lt\""
May 20 20:20:58.093836 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.093816    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 20 20:20:58.094040 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.094019    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 20 20:20:58.094263 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.094247    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 20 20:20:58.102123 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.102100    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk"]
May 20 20:20:58.137309 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.137269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71a1bb4a-1c4c-46a6-81d3-8be34209d4a3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk\" (UID: \"71a1bb4a-1c4c-46a6-81d3-8be34209d4a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk"
May 20 20:20:58.137474 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.137335    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqk6c\" (UniqueName: \"kubernetes.io/projected/71a1bb4a-1c4c-46a6-81d3-8be34209d4a3-kube-api-access-rqk6c\") pod \"managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk\" (UID: \"71a1bb4a-1c4c-46a6-81d3-8be34209d4a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk"
May 20 20:20:58.238083 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.238039    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71a1bb4a-1c4c-46a6-81d3-8be34209d4a3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk\" (UID: \"71a1bb4a-1c4c-46a6-81d3-8be34209d4a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk"
May 20 20:20:58.238270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.238104    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqk6c\" (UniqueName: \"kubernetes.io/projected/71a1bb4a-1c4c-46a6-81d3-8be34209d4a3-kube-api-access-rqk6c\") pod \"managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk\" (UID: \"71a1bb4a-1c4c-46a6-81d3-8be34209d4a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk"
May 20 20:20:58.242174 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.242149    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/71a1bb4a-1c4c-46a6-81d3-8be34209d4a3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk\" (UID: \"71a1bb4a-1c4c-46a6-81d3-8be34209d4a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk"
May 20 20:20:58.247524 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.247501    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqk6c\" (UniqueName: \"kubernetes.io/projected/71a1bb4a-1c4c-46a6-81d3-8be34209d4a3-kube-api-access-rqk6c\") pod \"managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk\" (UID: \"71a1bb4a-1c4c-46a6-81d3-8be34209d4a3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk"
May 20 20:20:58.422462 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.422427    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk"
May 20 20:20:58.541734 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.541704    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk"]
May 20 20:20:58.546262 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:20:58.546231    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71a1bb4a_1c4c_46a6_81d3_8be34209d4a3.slice/crio-dcd3b7c014d994755a3c1186e2d28a1b44b474525ec08875bf7e1bfaa5c8672f WatchSource:0}: Error finding container dcd3b7c014d994755a3c1186e2d28a1b44b474525ec08875bf7e1bfaa5c8672f: Status 404 returned error can't find the container with id dcd3b7c014d994755a3c1186e2d28a1b44b474525ec08875bf7e1bfaa5c8672f
May 20 20:20:58.741412 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.741325    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:20:58.741412 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.741361    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:20:58.741599 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:58.741467    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:20:58.741599 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:58.741475    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:20:58.741599 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:58.741497    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665b844584-vfxnf: secret "image-registry-tls" not found
May 20 20:20:58.741599 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:58.741527    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls podName:c12b8325-2b1d-4837-9d3d-7df8fb7b4f58 nodeName:}" failed. No retries permitted until 2026-05-20 20:21:30.74151358 +0000 UTC m=+97.188095776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls") pod "dns-default-8w2r7" (UID: "c12b8325-2b1d-4837-9d3d-7df8fb7b4f58") : secret "dns-default-metrics-tls" not found
May 20 20:20:58.741599 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:58.741551    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls podName:31d264fc-b175-4c94-99e6-17b75a5ac450 nodeName:}" failed. No retries permitted until 2026-05-20 20:21:30.741537136 +0000 UTC m=+97.188119331 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls") pod "image-registry-665b844584-vfxnf" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450") : secret "image-registry-tls" not found
May 20 20:20:58.842413 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.842375    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:20:58.842413 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.842415    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:20:58.842637 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:58.842516    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:20:58.842637 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:58.842564    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert podName:15c1ec37-1eb0-4805-9fb4-f651bb85f3d0 nodeName:}" failed. No retries permitted until 2026-05-20 20:21:30.842548808 +0000 UTC m=+97.289131002 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert") pod "ingress-canary-288pq" (UID: "15c1ec37-1eb0-4805-9fb4-f651bb85f3d0") : secret "canary-serving-cert" not found
May 20 20:20:58.844782 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.844762    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 20:20:58.852896 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:58.852881    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 20:20:58.852976 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:20:58.852936    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs podName:b58b9421-7735-48d6-ae02-be449d7adfb9 nodeName:}" failed. No retries permitted until 2026-05-20 20:22:02.852917275 +0000 UTC m=+129.299499470 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs") pod "network-metrics-daemon-5rhth" (UID: "b58b9421-7735-48d6-ae02-be449d7adfb9") : secret "metrics-daemon-secret" not found
May 20 20:20:58.943058 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.943021    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7\") pod \"network-check-target-vhz52\" (UID: \"0a6c4f77-30a4-414a-8c74-5d627a46b507\") " pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:58.945589 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.945570    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 20:20:58.955950 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.955925    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 20:20:58.966286 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:58.966264    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkdn7\" (UniqueName: \"kubernetes.io/projected/0a6c4f77-30a4-414a-8c74-5d627a46b507-kube-api-access-jkdn7\") pod \"network-check-target-vhz52\" (UID: \"0a6c4f77-30a4-414a-8c74-5d627a46b507\") " pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:59.261477 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:59.261450    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5c2rk\""
May 20 20:20:59.269358 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:59.269326    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:20:59.391284 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:59.391251    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vhz52"]
May 20 20:20:59.394241 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:20:59.394214    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6c4f77_30a4_414a_8c74_5d627a46b507.slice/crio-217a07bde745e5de1f699e730078d983825675163631145b136644c6d3dbe252 WatchSource:0}: Error finding container 217a07bde745e5de1f699e730078d983825675163631145b136644c6d3dbe252: Status 404 returned error can't find the container with id 217a07bde745e5de1f699e730078d983825675163631145b136644c6d3dbe252
May 20 20:20:59.403797 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:59.403768    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vhz52" event={"ID":"0a6c4f77-30a4-414a-8c74-5d627a46b507","Type":"ContainerStarted","Data":"217a07bde745e5de1f699e730078d983825675163631145b136644c6d3dbe252"}
May 20 20:20:59.404814 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:20:59.404786    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk" event={"ID":"71a1bb4a-1c4c-46a6-81d3-8be34209d4a3","Type":"ContainerStarted","Data":"dcd3b7c014d994755a3c1186e2d28a1b44b474525ec08875bf7e1bfaa5c8672f"}
May 20 20:21:03.414400 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:21:03.414360    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vhz52" event={"ID":"0a6c4f77-30a4-414a-8c74-5d627a46b507","Type":"ContainerStarted","Data":"59eccb97e81774969d4241a31eae2e0236b4f460292a27b98d549c3dd9bed4e0"}
May 20 20:21:03.414822 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:21:03.414481    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:21:03.415526 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:21:03.415504    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk" event={"ID":"71a1bb4a-1c4c-46a6-81d3-8be34209d4a3","Type":"ContainerStarted","Data":"fe909e2a957fc6911555b1dd5371245753e367c45dcb9f095aafb92b51ec8c12"}
May 20 20:21:03.445138 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:21:03.445089    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vhz52" podStartSLOduration=65.867276796 podStartE2EDuration="1m9.445077014s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="2026-05-20 20:20:59.396015833 +0000 UTC m=+65.842598032" lastFinishedPulling="2026-05-20 20:21:02.973816055 +0000 UTC m=+69.420398250" observedRunningTime="2026-05-20 20:21:03.444742062 +0000 UTC m=+69.891324278" watchObservedRunningTime="2026-05-20 20:21:03.445077014 +0000 UTC m=+69.891659228"
May 20 20:21:30.767877 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:21:30.767752    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:21:30.767877 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:21:30.767791    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:21:30.768408 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:21:30.767951    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:21:30.768408 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:21:30.767978    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665b844584-vfxnf: secret "image-registry-tls" not found
May 20 20:21:30.768408 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:21:30.767965    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:21:30.768408 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:21:30.768044    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls podName:31d264fc-b175-4c94-99e6-17b75a5ac450 nodeName:}" failed. No retries permitted until 2026-05-20 20:22:34.768021119 +0000 UTC m=+161.214603320 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls") pod "image-registry-665b844584-vfxnf" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450") : secret "image-registry-tls" not found
May 20 20:21:30.768408 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:21:30.768106    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls podName:c12b8325-2b1d-4837-9d3d-7df8fb7b4f58 nodeName:}" failed. No retries permitted until 2026-05-20 20:22:34.768093287 +0000 UTC m=+161.214675482 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls") pod "dns-default-8w2r7" (UID: "c12b8325-2b1d-4837-9d3d-7df8fb7b4f58") : secret "dns-default-metrics-tls" not found
May 20 20:21:30.868436 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:21:30.868394    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:21:30.868565 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:21:30.868520    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:21:30.868605 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:21:30.868584    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert podName:15c1ec37-1eb0-4805-9fb4-f651bb85f3d0 nodeName:}" failed. No retries permitted until 2026-05-20 20:22:34.868569708 +0000 UTC m=+161.315151903 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert") pod "ingress-canary-288pq" (UID: "15c1ec37-1eb0-4805-9fb4-f651bb85f3d0") : secret "canary-serving-cert" not found
May 20 20:21:34.420181 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:21:34.420149    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vhz52"
May 20 20:21:34.438939 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:21:34.438889    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk" podStartSLOduration=32.023894346 podStartE2EDuration="36.438874439s" podCreationTimestamp="2026-05-20 20:20:58 +0000 UTC" firstStartedPulling="2026-05-20 20:20:58.547975837 +0000 UTC m=+64.994558031" lastFinishedPulling="2026-05-20 20:21:02.962955911 +0000 UTC m=+69.409538124" observedRunningTime="2026-05-20 20:21:03.472629456 +0000 UTC m=+69.919211672" watchObservedRunningTime="2026-05-20 20:21:34.438874439 +0000 UTC m=+100.885456655"
May 20 20:22:02.891349 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:02.891295    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:22:02.891934 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:02.891500    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 20:22:02.891934 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:02.891603    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs podName:b58b9421-7735-48d6-ae02-be449d7adfb9 nodeName:}" failed. No retries permitted until 2026-05-20 20:24:04.891579883 +0000 UTC m=+251.338162101 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs") pod "network-metrics-daemon-5rhth" (UID: "b58b9421-7735-48d6-ae02-be449d7adfb9") : secret "metrics-daemon-secret" not found
May 20 20:22:23.434379 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.434348    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-ln6rr"]
May 20 20:22:23.436223 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.436208    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ln6rr"
May 20 20:22:23.439248 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.439224    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8fc89"]
May 20 20:22:23.439364 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.439264    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-98c4r\""
May 20 20:22:23.440772 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.440754    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-252gl"]
May 20 20:22:23.440900 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.440883    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8fc89"
May 20 20:22:23.442543 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.442526    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.443397 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.443377    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 20 20:22:23.443480 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.443435    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 20 20:22:23.443525 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.443497    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n8jvt\""
May 20 20:22:23.444960 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.444945    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 20 20:22:23.445043 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.445007    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kflbx\""
May 20 20:22:23.445369 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.445355    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 20 20:22:23.445676 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.445663    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 20 20:22:23.447367 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.447317    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 20 20:22:23.450845 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.450828    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 20 20:22:23.455344 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.455322    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-ln6rr"]
May 20 20:22:23.456409 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.456393    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8fc89"]
May 20 20:22:23.457468 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.457450    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-252gl"]
May 20 20:22:23.531176 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.531145    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"]
May 20 20:22:23.533184 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.533156    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"
May 20 20:22:23.534198 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.534174    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26c57738-105f-421c-82aa-1261642326be-config\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.534285 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.534272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrm8h\" (UniqueName: \"kubernetes.io/projected/281e3d99-9eb1-40d3-bf4b-fd4753b568fb-kube-api-access-mrm8h\") pod \"volume-data-source-validator-5cf8c89d64-8fc89\" (UID: \"281e3d99-9eb1-40d3-bf4b-fd4753b568fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8fc89"
May 20 20:22:23.534344 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.534297    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26c57738-105f-421c-82aa-1261642326be-trusted-ca\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.534344 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.534324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn5gj\" (UniqueName: \"kubernetes.io/projected/26c57738-105f-421c-82aa-1261642326be-kube-api-access-fn5gj\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.534417 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.534342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64fcfcf2-5717-4003-9c9a-b10e5f4f7089-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-cpww7\" (UID: \"64fcfcf2-5717-4003-9c9a-b10e5f4f7089\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"
May 20 20:22:23.534417 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.534371    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26c57738-105f-421c-82aa-1261642326be-serving-cert\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.534417 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.534395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64fcfcf2-5717-4003-9c9a-b10e5f4f7089-config\") pod \"kube-storage-version-migrator-operator-565644f49-cpww7\" (UID: \"64fcfcf2-5717-4003-9c9a-b10e5f4f7089\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"
May 20 20:22:23.534529 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.534415    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjjdm\" (UniqueName: \"kubernetes.io/projected/3bd5a5e4-9f88-422d-a1f4-3c12d4f7117c-kube-api-access-jjjdm\") pod \"network-check-source-7f44b6dd87-ln6rr\" (UID: \"3bd5a5e4-9f88-422d-a1f4-3c12d4f7117c\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ln6rr"
May 20 20:22:23.534529 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.534437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls7n9\" (UniqueName: \"kubernetes.io/projected/64fcfcf2-5717-4003-9c9a-b10e5f4f7089-kube-api-access-ls7n9\") pod \"kube-storage-version-migrator-operator-565644f49-cpww7\" (UID: \"64fcfcf2-5717-4003-9c9a-b10e5f4f7089\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"
May 20 20:22:23.535534 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.535508    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 20 20:22:23.535931 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.535915    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 20 20:22:23.536052 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.536034    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 20 20:22:23.536155 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.536133    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 20 20:22:23.536423 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.536408    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wwqtn\""
May 20 20:22:23.538885 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.538867    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"]
May 20 20:22:23.540623 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.540605    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:23.545712 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.545694    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 20 20:22:23.545989 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.545974    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nfbsk\""
May 20 20:22:23.547275 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.547258    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 20 20:22:23.547354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.547261    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 20 20:22:23.547846 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.547833    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 20 20:22:23.555424 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.555403    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"]
May 20 20:22:23.556568 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.556550    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"]
May 20 20:22:23.634842 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.634808    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64fcfcf2-5717-4003-9c9a-b10e5f4f7089-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-cpww7\" (UID: \"64fcfcf2-5717-4003-9c9a-b10e5f4f7089\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"
May 20 20:22:23.634842 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.634845    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26c57738-105f-421c-82aa-1261642326be-serving-cert\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.635105 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.634863    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64fcfcf2-5717-4003-9c9a-b10e5f4f7089-config\") pod \"kube-storage-version-migrator-operator-565644f49-cpww7\" (UID: \"64fcfcf2-5717-4003-9c9a-b10e5f4f7089\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"
May 20 20:22:23.635105 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.634881    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ls7n9\" (UniqueName: \"kubernetes.io/projected/64fcfcf2-5717-4003-9c9a-b10e5f4f7089-kube-api-access-ls7n9\") pod \"kube-storage-version-migrator-operator-565644f49-cpww7\" (UID: \"64fcfcf2-5717-4003-9c9a-b10e5f4f7089\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"
May 20 20:22:23.635105 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.634912    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26c57738-105f-421c-82aa-1261642326be-config\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.635105 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.634934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/01d1d8a5-7939-436e-8466-03ac29e4af5b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:23.635105 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.635067    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrm8h\" (UniqueName: \"kubernetes.io/projected/281e3d99-9eb1-40d3-bf4b-fd4753b568fb-kube-api-access-mrm8h\") pod \"volume-data-source-validator-5cf8c89d64-8fc89\" (UID: \"281e3d99-9eb1-40d3-bf4b-fd4753b568fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8fc89"
May 20 20:22:23.635105 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.635102    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26c57738-105f-421c-82aa-1261642326be-trusted-ca\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.635413 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.635142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds4wt\" (UniqueName: \"kubernetes.io/projected/01d1d8a5-7939-436e-8466-03ac29e4af5b-kube-api-access-ds4wt\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:23.635413 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.635178    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fn5gj\" (UniqueName: \"kubernetes.io/projected/26c57738-105f-421c-82aa-1261642326be-kube-api-access-fn5gj\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.635413 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.635247    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjjdm\" (UniqueName: \"kubernetes.io/projected/3bd5a5e4-9f88-422d-a1f4-3c12d4f7117c-kube-api-access-jjjdm\") pod \"network-check-source-7f44b6dd87-ln6rr\" (UID: \"3bd5a5e4-9f88-422d-a1f4-3c12d4f7117c\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ln6rr"
May 20 20:22:23.635543 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.635425    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:23.636499 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.635857    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64fcfcf2-5717-4003-9c9a-b10e5f4f7089-config\") pod \"kube-storage-version-migrator-operator-565644f49-cpww7\" (UID: \"64fcfcf2-5717-4003-9c9a-b10e5f4f7089\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"
May 20 20:22:23.636499 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.636469    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/26c57738-105f-421c-82aa-1261642326be-config\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.636499 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.636472    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26c57738-105f-421c-82aa-1261642326be-trusted-ca\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.640250 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.640226    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26c57738-105f-421c-82aa-1261642326be-serving-cert\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.640356 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.640284    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64fcfcf2-5717-4003-9c9a-b10e5f4f7089-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-cpww7\" (UID: \"64fcfcf2-5717-4003-9c9a-b10e5f4f7089\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"
May 20 20:22:23.643238 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.643187    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls7n9\" (UniqueName: \"kubernetes.io/projected/64fcfcf2-5717-4003-9c9a-b10e5f4f7089-kube-api-access-ls7n9\") pod \"kube-storage-version-migrator-operator-565644f49-cpww7\" (UID: \"64fcfcf2-5717-4003-9c9a-b10e5f4f7089\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"
May 20 20:22:23.643389 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.643304    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn5gj\" (UniqueName: \"kubernetes.io/projected/26c57738-105f-421c-82aa-1261642326be-kube-api-access-fn5gj\") pod \"console-operator-76dff48d59-252gl\" (UID: \"26c57738-105f-421c-82aa-1261642326be\") " pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.643452 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.643431    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjjdm\" (UniqueName: \"kubernetes.io/projected/3bd5a5e4-9f88-422d-a1f4-3c12d4f7117c-kube-api-access-jjjdm\") pod \"network-check-source-7f44b6dd87-ln6rr\" (UID: \"3bd5a5e4-9f88-422d-a1f4-3c12d4f7117c\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ln6rr"
May 20 20:22:23.643639 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.643622    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrm8h\" (UniqueName: \"kubernetes.io/projected/281e3d99-9eb1-40d3-bf4b-fd4753b568fb-kube-api-access-mrm8h\") pod \"volume-data-source-validator-5cf8c89d64-8fc89\" (UID: \"281e3d99-9eb1-40d3-bf4b-fd4753b568fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8fc89"
May 20 20:22:23.736357 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.736270    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/01d1d8a5-7939-436e-8466-03ac29e4af5b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:23.736357 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.736319    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ds4wt\" (UniqueName: \"kubernetes.io/projected/01d1d8a5-7939-436e-8466-03ac29e4af5b-kube-api-access-ds4wt\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:23.736357 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.736354    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:23.736626 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:23.736459    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:22:23.736626 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:23.736523    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls podName:01d1d8a5-7939-436e-8466-03ac29e4af5b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:24.236505085 +0000 UTC m=+150.683087280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dpm5g" (UID: "01d1d8a5-7939-436e-8466-03ac29e4af5b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:22:23.737094 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.737068    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/01d1d8a5-7939-436e-8466-03ac29e4af5b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:23.745523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.745495    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ln6rr"
May 20 20:22:23.747455 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.747434    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds4wt\" (UniqueName: \"kubernetes.io/projected/01d1d8a5-7939-436e-8466-03ac29e4af5b-kube-api-access-ds4wt\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:23.752256 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.752236    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8fc89"
May 20 20:22:23.759037 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.758905    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:23.842764 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.842738    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"
May 20 20:22:23.893822 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.893669    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-ln6rr"]
May 20 20:22:23.896942 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:22:23.896910    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd5a5e4_9f88_422d_a1f4_3c12d4f7117c.slice/crio-db62a5425cd8b67548da317fbf54b9372c8c7b8aee26e39c25df26a0433e6bb6 WatchSource:0}: Error finding container db62a5425cd8b67548da317fbf54b9372c8c7b8aee26e39c25df26a0433e6bb6: Status 404 returned error can't find the container with id db62a5425cd8b67548da317fbf54b9372c8c7b8aee26e39c25df26a0433e6bb6
May 20 20:22:23.975831 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:23.975803    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7"]
May 20 20:22:23.978588 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:22:23.978564    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64fcfcf2_5717_4003_9c9a_b10e5f4f7089.slice/crio-279b1da8b2d5c1f58c7e5952973bf69da4db1c1ef266191a525afe6ed3c9e6b6 WatchSource:0}: Error finding container 279b1da8b2d5c1f58c7e5952973bf69da4db1c1ef266191a525afe6ed3c9e6b6: Status 404 returned error can't find the container with id 279b1da8b2d5c1f58c7e5952973bf69da4db1c1ef266191a525afe6ed3c9e6b6
May 20 20:22:24.113471 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:24.113400    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-252gl"]
May 20 20:22:24.115942 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:24.115917    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8fc89"]
May 20 20:22:24.116679 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:22:24.116659    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c57738_105f_421c_82aa_1261642326be.slice/crio-af83090c6b423dd9fe1255fa73ad675a86b668e7f04fa1e353d2be53b686589a WatchSource:0}: Error finding container af83090c6b423dd9fe1255fa73ad675a86b668e7f04fa1e353d2be53b686589a: Status 404 returned error can't find the container with id af83090c6b423dd9fe1255fa73ad675a86b668e7f04fa1e353d2be53b686589a
May 20 20:22:24.119024 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:22:24.119005    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod281e3d99_9eb1_40d3_bf4b_fd4753b568fb.slice/crio-c13003509f76b1c0d5b78d7657ed16d235b83ff90617a64f6cc526ac690e84ec WatchSource:0}: Error finding container c13003509f76b1c0d5b78d7657ed16d235b83ff90617a64f6cc526ac690e84ec: Status 404 returned error can't find the container with id c13003509f76b1c0d5b78d7657ed16d235b83ff90617a64f6cc526ac690e84ec
May 20 20:22:24.242210 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:24.242164    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:24.242379 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:24.242327    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:22:24.242435 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:24.242403    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls podName:01d1d8a5-7939-436e-8466-03ac29e4af5b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:25.242382329 +0000 UTC m=+151.688964540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dpm5g" (UID: "01d1d8a5-7939-436e-8466-03ac29e4af5b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:22:24.573563 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:24.573522    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ln6rr" event={"ID":"3bd5a5e4-9f88-422d-a1f4-3c12d4f7117c","Type":"ContainerStarted","Data":"2885a7dfd4ab98ce2948b04fab0b3aa7bdf153883a62b966946eb86a55cbb208"}
May 20 20:22:24.573563 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:24.573568    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ln6rr" event={"ID":"3bd5a5e4-9f88-422d-a1f4-3c12d4f7117c","Type":"ContainerStarted","Data":"db62a5425cd8b67548da317fbf54b9372c8c7b8aee26e39c25df26a0433e6bb6"}
May 20 20:22:24.574890 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:24.574768    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-252gl" event={"ID":"26c57738-105f-421c-82aa-1261642326be","Type":"ContainerStarted","Data":"af83090c6b423dd9fe1255fa73ad675a86b668e7f04fa1e353d2be53b686589a"}
May 20 20:22:24.575712 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:24.575683    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8fc89" event={"ID":"281e3d99-9eb1-40d3-bf4b-fd4753b568fb","Type":"ContainerStarted","Data":"c13003509f76b1c0d5b78d7657ed16d235b83ff90617a64f6cc526ac690e84ec"}
May 20 20:22:24.576797 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:24.576771    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7" event={"ID":"64fcfcf2-5717-4003-9c9a-b10e5f4f7089","Type":"ContainerStarted","Data":"279b1da8b2d5c1f58c7e5952973bf69da4db1c1ef266191a525afe6ed3c9e6b6"}
May 20 20:22:24.590594 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:24.590546    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-ln6rr" podStartSLOduration=1.590527738 podStartE2EDuration="1.590527738s" podCreationTimestamp="2026-05-20 20:22:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:22:24.588989762 +0000 UTC m=+151.035571991" watchObservedRunningTime="2026-05-20 20:22:24.590527738 +0000 UTC m=+151.037109957"
May 20 20:22:25.251728 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:25.251655    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:25.251892 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:25.251808    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:22:25.251892 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:25.251883    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls podName:01d1d8a5-7939-436e-8466-03ac29e4af5b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:27.25186451 +0000 UTC m=+153.698446706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dpm5g" (UID: "01d1d8a5-7939-436e-8466-03ac29e4af5b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:22:26.603061 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:26.602971    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7" podStartSLOduration=1.069748164 podStartE2EDuration="3.602952784s" podCreationTimestamp="2026-05-20 20:22:23 +0000 UTC" firstStartedPulling="2026-05-20 20:22:23.980293936 +0000 UTC m=+150.426876131" lastFinishedPulling="2026-05-20 20:22:26.513498553 +0000 UTC m=+152.960080751" observedRunningTime="2026-05-20 20:22:26.602294642 +0000 UTC m=+153.048876861" watchObservedRunningTime="2026-05-20 20:22:26.602952784 +0000 UTC m=+153.049535005"
May 20 20:22:27.268879 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:27.268829    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:27.269056 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:27.268979    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:22:27.269056 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:27.269041    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls podName:01d1d8a5-7939-436e-8466-03ac29e4af5b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:31.269027108 +0000 UTC m=+157.715609303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dpm5g" (UID: "01d1d8a5-7939-436e-8466-03ac29e4af5b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:22:27.590431 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:27.590333    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7" event={"ID":"64fcfcf2-5717-4003-9c9a-b10e5f4f7089","Type":"ContainerStarted","Data":"5cbe5d68e53d7cf0586e97ecce1e0b8ae7160c14001452320f9a5383d1672d08"}
May 20 20:22:27.591643 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:27.591623    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/0.log"
May 20 20:22:27.591771 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:27.591658    2575 generic.go:358] "Generic (PLEG): container finished" podID="26c57738-105f-421c-82aa-1261642326be" containerID="4bb0836b07660bbf8fde82608a6721b8de062d75d14b0f3976065d373b068c76" exitCode=255
May 20 20:22:27.591771 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:27.591711    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-252gl" event={"ID":"26c57738-105f-421c-82aa-1261642326be","Type":"ContainerDied","Data":"4bb0836b07660bbf8fde82608a6721b8de062d75d14b0f3976065d373b068c76"}
May 20 20:22:27.591932 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:27.591911    2575 scope.go:117] "RemoveContainer" containerID="4bb0836b07660bbf8fde82608a6721b8de062d75d14b0f3976065d373b068c76"
May 20 20:22:27.592991 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:27.592966    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8fc89" event={"ID":"281e3d99-9eb1-40d3-bf4b-fd4753b568fb","Type":"ContainerStarted","Data":"ed95e7c60705515b71703daebb8ec4c7340078b1073eb61572b83000cc4d3f76"}
May 20 20:22:27.624854 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:27.624814    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-8fc89" podStartSLOduration=2.234554351 podStartE2EDuration="4.624800751s" podCreationTimestamp="2026-05-20 20:22:23 +0000 UTC" firstStartedPulling="2026-05-20 20:22:24.12105823 +0000 UTC m=+150.567640428" lastFinishedPulling="2026-05-20 20:22:26.51130463 +0000 UTC m=+152.957886828" observedRunningTime="2026-05-20 20:22:27.624719385 +0000 UTC m=+154.071301602" watchObservedRunningTime="2026-05-20 20:22:27.624800751 +0000 UTC m=+154.071382968"
May 20 20:22:28.597246 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:28.597219    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/1.log"
May 20 20:22:28.597598 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:28.597581    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/0.log"
May 20 20:22:28.597696 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:28.597621    2575 generic.go:358] "Generic (PLEG): container finished" podID="26c57738-105f-421c-82aa-1261642326be" containerID="6abac74648f26d008a2cf831fee4f6ba0ce29456835d5a861c8b700e7de168ed" exitCode=255
May 20 20:22:28.597740 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:28.597717    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-252gl" event={"ID":"26c57738-105f-421c-82aa-1261642326be","Type":"ContainerDied","Data":"6abac74648f26d008a2cf831fee4f6ba0ce29456835d5a861c8b700e7de168ed"}
May 20 20:22:28.597788 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:28.597767    2575 scope.go:117] "RemoveContainer" containerID="4bb0836b07660bbf8fde82608a6721b8de062d75d14b0f3976065d373b068c76"
May 20 20:22:28.597989 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:28.597969    2575 scope.go:117] "RemoveContainer" containerID="6abac74648f26d008a2cf831fee4f6ba0ce29456835d5a861c8b700e7de168ed"
May 20 20:22:28.598241 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:28.598211    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-252gl_openshift-console-operator(26c57738-105f-421c-82aa-1261642326be)\"" pod="openshift-console-operator/console-operator-76dff48d59-252gl" podUID="26c57738-105f-421c-82aa-1261642326be"
May 20 20:22:29.601600 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:29.601574    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/1.log"
May 20 20:22:29.602171 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:29.602013    2575 scope.go:117] "RemoveContainer" containerID="6abac74648f26d008a2cf831fee4f6ba0ce29456835d5a861c8b700e7de168ed"
May 20 20:22:29.602271 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:29.602249    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-252gl_openshift-console-operator(26c57738-105f-421c-82aa-1261642326be)\"" pod="openshift-console-operator/console-operator-76dff48d59-252gl" podUID="26c57738-105f-421c-82aa-1261642326be"
May 20 20:22:29.901121 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:29.901093    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z2rgw_a8afe344-be23-4700-9ff6-95fa7d945bd8/dns-node-resolver/0.log"
May 20 20:22:29.915707 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:29.915676    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-665b844584-vfxnf" podUID="31d264fc-b175-4c94-99e6-17b75a5ac450"
May 20 20:22:29.931830 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:29.931804    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8w2r7" podUID="c12b8325-2b1d-4837-9d3d-7df8fb7b4f58"
May 20 20:22:29.944972 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:29.944949    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-288pq" podUID="15c1ec37-1eb0-4805-9fb4-f651bb85f3d0"
May 20 20:22:30.165186 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:30.165107    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5rhth" podUID="b58b9421-7735-48d6-ae02-be449d7adfb9"
May 20 20:22:30.502033 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:30.501952    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dbzh4_159c1ebf-42c3-4fe7-b624-208c0435814d/node-ca/0.log"
May 20 20:22:30.606185 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:30.606149    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8w2r7"
May 20 20:22:30.606185 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:30.606166    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:22:31.302049 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:31.301960    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:31.302218 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:31.302113    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:22:31.302218 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:31.302181    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls podName:01d1d8a5-7939-436e-8466-03ac29e4af5b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:39.302165242 +0000 UTC m=+165.748747437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dpm5g" (UID: "01d1d8a5-7939-436e-8466-03ac29e4af5b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:22:33.759459 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:33.759411    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:33.759459 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:33.759467    2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:33.759919 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:33.759813    2575 scope.go:117] "RemoveContainer" containerID="6abac74648f26d008a2cf831fee4f6ba0ce29456835d5a861c8b700e7de168ed"
May 20 20:22:33.759992 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:33.759974    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-252gl_openshift-console-operator(26c57738-105f-421c-82aa-1261642326be)\"" pod="openshift-console-operator/console-operator-76dff48d59-252gl" podUID="26c57738-105f-421c-82aa-1261642326be"
May 20 20:22:34.831635 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:34.831602    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:22:34.832024 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:34.831642    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls\") pod \"image-registry-665b844584-vfxnf\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") " pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:22:34.832024 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:34.831742    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 20:22:34.832024 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:34.831754    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665b844584-vfxnf: secret "image-registry-tls" not found
May 20 20:22:34.832024 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:34.831806    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls podName:31d264fc-b175-4c94-99e6-17b75a5ac450 nodeName:}" failed. No retries permitted until 2026-05-20 20:24:36.831792232 +0000 UTC m=+283.278374427 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls") pod "image-registry-665b844584-vfxnf" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450") : secret "image-registry-tls" not found
May 20 20:22:34.832024 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:34.831742    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 20:22:34.832024 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:34.831875    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls podName:c12b8325-2b1d-4837-9d3d-7df8fb7b4f58 nodeName:}" failed. No retries permitted until 2026-05-20 20:24:36.83186204 +0000 UTC m=+283.278444235 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls") pod "dns-default-8w2r7" (UID: "c12b8325-2b1d-4837-9d3d-7df8fb7b4f58") : secret "dns-default-metrics-tls" not found
May 20 20:22:34.933022 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:34.932972    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:22:34.933187 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:34.933090    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 20:22:34.933187 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:34.933143    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert podName:15c1ec37-1eb0-4805-9fb4-f651bb85f3d0 nodeName:}" failed. No retries permitted until 2026-05-20 20:24:36.93312896 +0000 UTC m=+283.379711154 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert") pod "ingress-canary-288pq" (UID: "15c1ec37-1eb0-4805-9fb4-f651bb85f3d0") : secret "canary-serving-cert" not found
May 20 20:22:39.367555 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:39.367518    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:39.367936 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:39.367659    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 20:22:39.367936 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:39.367737    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls podName:01d1d8a5-7939-436e-8466-03ac29e4af5b nodeName:}" failed. No retries permitted until 2026-05-20 20:22:55.367720532 +0000 UTC m=+181.814302726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-dpm5g" (UID: "01d1d8a5-7939-436e-8466-03ac29e4af5b") : secret "cluster-monitoring-operator-tls" not found
May 20 20:22:41.138486 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:41.138449    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:22:43.139019 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:43.138988    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:22:49.139070 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:49.139035    2575 scope.go:117] "RemoveContainer" containerID="6abac74648f26d008a2cf831fee4f6ba0ce29456835d5a861c8b700e7de168ed"
May 20 20:22:49.654205 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:49.654164    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:22:49.654550 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:49.654535    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/1.log"
May 20 20:22:49.654602 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:49.654568    2575 generic.go:358] "Generic (PLEG): container finished" podID="26c57738-105f-421c-82aa-1261642326be" containerID="54ba195f2ea114fd1284bf2623e9e1c2c35644172221f37a829da2016db90cb1" exitCode=255
May 20 20:22:49.654643 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:49.654611    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-252gl" event={"ID":"26c57738-105f-421c-82aa-1261642326be","Type":"ContainerDied","Data":"54ba195f2ea114fd1284bf2623e9e1c2c35644172221f37a829da2016db90cb1"}
May 20 20:22:49.654643 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:49.654638    2575 scope.go:117] "RemoveContainer" containerID="6abac74648f26d008a2cf831fee4f6ba0ce29456835d5a861c8b700e7de168ed"
May 20 20:22:49.654963 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:49.654947    2575 scope.go:117] "RemoveContainer" containerID="54ba195f2ea114fd1284bf2623e9e1c2c35644172221f37a829da2016db90cb1"
May 20 20:22:49.655148 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:49.655126    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-252gl_openshift-console-operator(26c57738-105f-421c-82aa-1261642326be)\"" pod="openshift-console-operator/console-operator-76dff48d59-252gl" podUID="26c57738-105f-421c-82aa-1261642326be"
May 20 20:22:50.658458 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:50.658429    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:22:51.413737 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.413708    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-665b844584-vfxnf"]
May 20 20:22:51.413904 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:51.413873    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-665b844584-vfxnf" podUID="31d264fc-b175-4c94-99e6-17b75a5ac450"
May 20 20:22:51.436255 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.436230    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zwfzg"]
May 20 20:22:51.439505 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.439489    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.441672 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.441642    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 20 20:22:51.441672 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.441667    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 20 20:22:51.441825 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.441701    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 20 20:22:51.441874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.441836    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 20 20:22:51.442647 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.442628    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rrmkh\""
May 20 20:22:51.449393 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.449372    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zwfzg"]
May 20 20:22:51.463475 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.463457    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d75bc698b-vhtbp"]
May 20 20:22:51.465307 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.465293    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.478476 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.478456    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d75bc698b-vhtbp"]
May 20 20:22:51.557916 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.557874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf3f9412-1d90-4eaf-bd89-bd5a649db712-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.558110 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.557915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84386a5b-6b8a-45da-aa84-f6a252a57727-bound-sa-token\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.558110 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.557968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84386a5b-6b8a-45da-aa84-f6a252a57727-ca-trust-extracted\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.558110 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.558011    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84386a5b-6b8a-45da-aa84-f6a252a57727-registry-certificates\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.558110 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.558046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf3f9412-1d90-4eaf-bd89-bd5a649db712-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.558110 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.558096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5jpp\" (UniqueName: \"kubernetes.io/projected/84386a5b-6b8a-45da-aa84-f6a252a57727-kube-api-access-r5jpp\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.558354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.558120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf3f9412-1d90-4eaf-bd89-bd5a649db712-data-volume\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.558354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.558143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84386a5b-6b8a-45da-aa84-f6a252a57727-trusted-ca\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.558354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.558184    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf3f9412-1d90-4eaf-bd89-bd5a649db712-crio-socket\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.558354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.558242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84386a5b-6b8a-45da-aa84-f6a252a57727-registry-tls\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.558354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.558262    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84386a5b-6b8a-45da-aa84-f6a252a57727-installation-pull-secrets\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.558354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.558286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84386a5b-6b8a-45da-aa84-f6a252a57727-image-registry-private-configuration\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.558354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.558331    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l598w\" (UniqueName: \"kubernetes.io/projected/bf3f9412-1d90-4eaf-bd89-bd5a649db712-kube-api-access-l598w\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.658877 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.658845    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf3f9412-1d90-4eaf-bd89-bd5a649db712-crio-socket\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.659324 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.658887    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84386a5b-6b8a-45da-aa84-f6a252a57727-registry-tls\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.659324 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.658911    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84386a5b-6b8a-45da-aa84-f6a252a57727-installation-pull-secrets\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.659324 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.658942    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84386a5b-6b8a-45da-aa84-f6a252a57727-image-registry-private-configuration\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.659324 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.658946    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf3f9412-1d90-4eaf-bd89-bd5a649db712-crio-socket\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.659324 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.658976    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l598w\" (UniqueName: \"kubernetes.io/projected/bf3f9412-1d90-4eaf-bd89-bd5a649db712-kube-api-access-l598w\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.659324 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.659225    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf3f9412-1d90-4eaf-bd89-bd5a649db712-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.659324 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.659260    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84386a5b-6b8a-45da-aa84-f6a252a57727-bound-sa-token\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.659324 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.659298    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84386a5b-6b8a-45da-aa84-f6a252a57727-ca-trust-extracted\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.659755 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.659331    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84386a5b-6b8a-45da-aa84-f6a252a57727-registry-certificates\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.659755 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.659505    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf3f9412-1d90-4eaf-bd89-bd5a649db712-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.659755 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.659661    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5jpp\" (UniqueName: \"kubernetes.io/projected/84386a5b-6b8a-45da-aa84-f6a252a57727-kube-api-access-r5jpp\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.659755 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.659696    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84386a5b-6b8a-45da-aa84-f6a252a57727-ca-trust-extracted\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.659956 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.659874    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf3f9412-1d90-4eaf-bd89-bd5a649db712-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.659956 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.659701    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf3f9412-1d90-4eaf-bd89-bd5a649db712-data-volume\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.660060 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.659975    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84386a5b-6b8a-45da-aa84-f6a252a57727-trusted-ca\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.660060 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.660026    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf3f9412-1d90-4eaf-bd89-bd5a649db712-data-volume\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.660399 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.660356    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84386a5b-6b8a-45da-aa84-f6a252a57727-registry-certificates\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.660960 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.660938    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:22:51.661091 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.661031    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84386a5b-6b8a-45da-aa84-f6a252a57727-trusted-ca\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.661941 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.661914    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84386a5b-6b8a-45da-aa84-f6a252a57727-registry-tls\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.662097 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.662079    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84386a5b-6b8a-45da-aa84-f6a252a57727-image-registry-private-configuration\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.662156 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.662125    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf3f9412-1d90-4eaf-bd89-bd5a649db712-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.662216 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.662179    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84386a5b-6b8a-45da-aa84-f6a252a57727-installation-pull-secrets\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.671519 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.671469    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84386a5b-6b8a-45da-aa84-f6a252a57727-bound-sa-token\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.671654 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.671638    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l598w\" (UniqueName: \"kubernetes.io/projected/bf3f9412-1d90-4eaf-bd89-bd5a649db712-kube-api-access-l598w\") pod \"insights-runtime-extractor-zwfzg\" (UID: \"bf3f9412-1d90-4eaf-bd89-bd5a649db712\") " pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.672111 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.672095    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5jpp\" (UniqueName: \"kubernetes.io/projected/84386a5b-6b8a-45da-aa84-f6a252a57727-kube-api-access-r5jpp\") pod \"image-registry-6d75bc698b-vhtbp\" (UID: \"84386a5b-6b8a-45da-aa84-f6a252a57727\") " pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.682868 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.682851    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:22:51.747717 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.747689    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zwfzg"
May 20 20:22:51.762008 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.761986    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-installation-pull-secrets\") pod \"31d264fc-b175-4c94-99e6-17b75a5ac450\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") "
May 20 20:22:51.762096 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.762028    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-trusted-ca\") pod \"31d264fc-b175-4c94-99e6-17b75a5ac450\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") "
May 20 20:22:51.762096 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.762053    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31d264fc-b175-4c94-99e6-17b75a5ac450-ca-trust-extracted\") pod \"31d264fc-b175-4c94-99e6-17b75a5ac450\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") "
May 20 20:22:51.762096 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.762084    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-certificates\") pod \"31d264fc-b175-4c94-99e6-17b75a5ac450\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") "
May 20 20:22:51.762239 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.762137    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-image-registry-private-configuration\") pod \"31d264fc-b175-4c94-99e6-17b75a5ac450\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") "
May 20 20:22:51.762239 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.762186    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-bound-sa-token\") pod \"31d264fc-b175-4c94-99e6-17b75a5ac450\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") "
May 20 20:22:51.762239 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.762235    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-924qr\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-kube-api-access-924qr\") pod \"31d264fc-b175-4c94-99e6-17b75a5ac450\" (UID: \"31d264fc-b175-4c94-99e6-17b75a5ac450\") "
May 20 20:22:51.762445 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.762403    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31d264fc-b175-4c94-99e6-17b75a5ac450-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "31d264fc-b175-4c94-99e6-17b75a5ac450" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:22:51.762549 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.762486    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31d264fc-b175-4c94-99e6-17b75a5ac450-ca-trust-extracted\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:22:51.762549 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.762504    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "31d264fc-b175-4c94-99e6-17b75a5ac450" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:22:51.762549 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.762510    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "31d264fc-b175-4c94-99e6-17b75a5ac450" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:22:51.764473 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.764447    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "31d264fc-b175-4c94-99e6-17b75a5ac450" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:22:51.764561 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.764479    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-kube-api-access-924qr" (OuterVolumeSpecName: "kube-api-access-924qr") pod "31d264fc-b175-4c94-99e6-17b75a5ac450" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450"). InnerVolumeSpecName "kube-api-access-924qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:22:51.764748 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.764724    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "31d264fc-b175-4c94-99e6-17b75a5ac450" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:22:51.764826 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.764766    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "31d264fc-b175-4c94-99e6-17b75a5ac450" (UID: "31d264fc-b175-4c94-99e6-17b75a5ac450"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:22:51.778564 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.778541    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lck56\""
May 20 20:22:51.784510 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.784482    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:51.862906 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.862872    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-image-registry-private-configuration\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:22:51.862906 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.862902    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-bound-sa-token\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:22:51.862906 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.862913    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-924qr\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-kube-api-access-924qr\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:22:51.863134 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.862922    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31d264fc-b175-4c94-99e6-17b75a5ac450-installation-pull-secrets\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:22:51.863134 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.862933    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-trusted-ca\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:22:51.863134 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.862942    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-certificates\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:22:51.895284 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.895256    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zwfzg"]
May 20 20:22:51.897794 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:22:51.897762    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3f9412_1d90_4eaf_bd89_bd5a649db712.slice/crio-2baafc4e632b874019eb6ca43685a110736f383e86e9e2b6a80e34b4c7973a90 WatchSource:0}: Error finding container 2baafc4e632b874019eb6ca43685a110736f383e86e9e2b6a80e34b4c7973a90: Status 404 returned error can't find the container with id 2baafc4e632b874019eb6ca43685a110736f383e86e9e2b6a80e34b4c7973a90
May 20 20:22:51.936629 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:51.936607    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d75bc698b-vhtbp"]
May 20 20:22:51.939809 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:22:51.939779    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84386a5b_6b8a_45da_aa84_f6a252a57727.slice/crio-43678dd2b4149c65d79f8c4fa490b1776c2098c90f5dcb80037481c2438d7c4b WatchSource:0}: Error finding container 43678dd2b4149c65d79f8c4fa490b1776c2098c90f5dcb80037481c2438d7c4b: Status 404 returned error can't find the container with id 43678dd2b4149c65d79f8c4fa490b1776c2098c90f5dcb80037481c2438d7c4b
May 20 20:22:52.664522 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:52.664486    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" event={"ID":"84386a5b-6b8a-45da-aa84-f6a252a57727","Type":"ContainerStarted","Data":"ee3d9ae97d7a8dbf6464c3931fb827133427918a1a3eb4613d6870c32338cf63"}
May 20 20:22:52.664522 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:52.664525    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" event={"ID":"84386a5b-6b8a-45da-aa84-f6a252a57727","Type":"ContainerStarted","Data":"43678dd2b4149c65d79f8c4fa490b1776c2098c90f5dcb80037481c2438d7c4b"}
May 20 20:22:52.664969 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:52.664617    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:22:52.666140 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:52.666114    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwfzg" event={"ID":"bf3f9412-1d90-4eaf-bd89-bd5a649db712","Type":"ContainerStarted","Data":"a07fcc1f2b3e425627b8ce63160f3bb51a4852d0186575741a0134ad30f90fdf"}
May 20 20:22:52.666263 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:52.666145    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwfzg" event={"ID":"bf3f9412-1d90-4eaf-bd89-bd5a649db712","Type":"ContainerStarted","Data":"4f999ba39a74625984fae7fd1ad14852e60a6b350f91a22f089b7c099e2e1c90"}
May 20 20:22:52.666263 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:52.666161    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwfzg" event={"ID":"bf3f9412-1d90-4eaf-bd89-bd5a649db712","Type":"ContainerStarted","Data":"2baafc4e632b874019eb6ca43685a110736f383e86e9e2b6a80e34b4c7973a90"}
May 20 20:22:52.666263 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:52.666146    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665b844584-vfxnf"
May 20 20:22:52.684871 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:52.684828    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podStartSLOduration=1.684816085 podStartE2EDuration="1.684816085s" podCreationTimestamp="2026-05-20 20:22:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:22:52.683890151 +0000 UTC m=+179.130472403" watchObservedRunningTime="2026-05-20 20:22:52.684816085 +0000 UTC m=+179.131398302"
May 20 20:22:52.715496 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:52.715467    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-665b844584-vfxnf"]
May 20 20:22:52.720114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:52.720093    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-665b844584-vfxnf"]
May 20 20:22:52.770245 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:52.770185    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d264fc-b175-4c94-99e6-17b75a5ac450-registry-tls\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:22:53.759700 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:53.759663    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:53.760151 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:53.759719    2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:22:53.760151 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:53.760126    2575 scope.go:117] "RemoveContainer" containerID="54ba195f2ea114fd1284bf2623e9e1c2c35644172221f37a829da2016db90cb1"
May 20 20:22:53.760354 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:22:53.760328    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-252gl_openshift-console-operator(26c57738-105f-421c-82aa-1261642326be)\"" pod="openshift-console-operator/console-operator-76dff48d59-252gl" podUID="26c57738-105f-421c-82aa-1261642326be"
May 20 20:22:54.147082 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:54.147045    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31d264fc-b175-4c94-99e6-17b75a5ac450" path="/var/lib/kubelet/pods/31d264fc-b175-4c94-99e6-17b75a5ac450/volumes"
May 20 20:22:54.673635 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:54.673598    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwfzg" event={"ID":"bf3f9412-1d90-4eaf-bd89-bd5a649db712","Type":"ContainerStarted","Data":"5850d33f0d7e488cf21cc1f5276b5496368d4d826728ab73e64bd7f19564b0a1"}
May 20 20:22:54.693862 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:54.693819    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zwfzg" podStartSLOduration=1.812943119 podStartE2EDuration="3.693804595s" podCreationTimestamp="2026-05-20 20:22:51 +0000 UTC" firstStartedPulling="2026-05-20 20:22:51.970666107 +0000 UTC m=+178.417248301" lastFinishedPulling="2026-05-20 20:22:53.85152758 +0000 UTC m=+180.298109777" observedRunningTime="2026-05-20 20:22:54.692554787 +0000 UTC m=+181.139137006" watchObservedRunningTime="2026-05-20 20:22:54.693804595 +0000 UTC m=+181.140386815"
May 20 20:22:55.392503 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:55.392465    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:55.394796 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:55.394775    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/01d1d8a5-7939-436e-8466-03ac29e4af5b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-dpm5g\" (UID: \"01d1d8a5-7939-436e-8466-03ac29e4af5b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:55.651416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:55.651336    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nfbsk\""
May 20 20:22:55.659865 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:55.659839    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"
May 20 20:22:55.777319 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:55.777290    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g"]
May 20 20:22:55.780378 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:22:55.780352    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d1d8a5_7939_436e_8466_03ac29e4af5b.slice/crio-f0952820f9cf92d78f29cb576dd4945eab4f7d2d26fbfda6c52f598c38036b2a WatchSource:0}: Error finding container f0952820f9cf92d78f29cb576dd4945eab4f7d2d26fbfda6c52f598c38036b2a: Status 404 returned error can't find the container with id f0952820f9cf92d78f29cb576dd4945eab4f7d2d26fbfda6c52f598c38036b2a
May 20 20:22:56.680414 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:56.680375    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g" event={"ID":"01d1d8a5-7939-436e-8466-03ac29e4af5b","Type":"ContainerStarted","Data":"f0952820f9cf92d78f29cb576dd4945eab4f7d2d26fbfda6c52f598c38036b2a"}
May 20 20:22:58.385034 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.385004    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt"]
May 20 20:22:58.388051 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.388033    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt"
May 20 20:22:58.390361 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.390329    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 20 20:22:58.390475 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.390459    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-p8ngl\""
May 20 20:22:58.396397 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.396370    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt"]
May 20 20:22:58.518690 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.518658    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fdb5dd5b-66f4-43b3-96c1-47ef62f7ac0a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt\" (UID: \"fdb5dd5b-66f4-43b3-96c1-47ef62f7ac0a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt"
May 20 20:22:58.619367 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.619336    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fdb5dd5b-66f4-43b3-96c1-47ef62f7ac0a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt\" (UID: \"fdb5dd5b-66f4-43b3-96c1-47ef62f7ac0a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt"
May 20 20:22:58.621815 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.621781    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fdb5dd5b-66f4-43b3-96c1-47ef62f7ac0a-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt\" (UID: \"fdb5dd5b-66f4-43b3-96c1-47ef62f7ac0a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt"
May 20 20:22:58.687315 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.687232    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g" event={"ID":"01d1d8a5-7939-436e-8466-03ac29e4af5b","Type":"ContainerStarted","Data":"c40928a47b0853d60844bfdf0a22969cfa3f3bb4c53f506de323ce5f07da5c33"}
May 20 20:22:58.701257 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.701238    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt"
May 20 20:22:58.704047 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.704009    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-dpm5g" podStartSLOduration=33.577056695 podStartE2EDuration="35.70399776s" podCreationTimestamp="2026-05-20 20:22:23 +0000 UTC" firstStartedPulling="2026-05-20 20:22:55.781987025 +0000 UTC m=+182.228569220" lastFinishedPulling="2026-05-20 20:22:57.908928088 +0000 UTC m=+184.355510285" observedRunningTime="2026-05-20 20:22:58.703222156 +0000 UTC m=+185.149804370" watchObservedRunningTime="2026-05-20 20:22:58.70399776 +0000 UTC m=+185.150579977"
May 20 20:22:58.825241 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:58.825186    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt"]
May 20 20:22:58.828474 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:22:58.828445    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb5dd5b_66f4_43b3_96c1_47ef62f7ac0a.slice/crio-a51efa157caaae79bed8113f1c8c5bdc13989d46609419802e522d4e16049006 WatchSource:0}: Error finding container a51efa157caaae79bed8113f1c8c5bdc13989d46609419802e522d4e16049006: Status 404 returned error can't find the container with id a51efa157caaae79bed8113f1c8c5bdc13989d46609419802e522d4e16049006
May 20 20:22:59.691204 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:22:59.691150    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt" event={"ID":"fdb5dd5b-66f4-43b3-96c1-47ef62f7ac0a","Type":"ContainerStarted","Data":"a51efa157caaae79bed8113f1c8c5bdc13989d46609419802e522d4e16049006"}
May 20 20:23:00.696372 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:00.696336    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt" event={"ID":"fdb5dd5b-66f4-43b3-96c1-47ef62f7ac0a","Type":"ContainerStarted","Data":"bcef50d5a005f88aa39b3c7256d81db36d3fcc5677c34a571b0d76054bddf56b"}
May 20 20:23:00.696775 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:00.696538    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt"
May 20 20:23:00.701054 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:00.701032    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt"
May 20 20:23:00.711604 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:00.711568    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt" podStartSLOduration=1.737340667 podStartE2EDuration="2.711558681s" podCreationTimestamp="2026-05-20 20:22:58 +0000 UTC" firstStartedPulling="2026-05-20 20:22:58.830344894 +0000 UTC m=+185.276927089" lastFinishedPulling="2026-05-20 20:22:59.804562909 +0000 UTC m=+186.251145103" observedRunningTime="2026-05-20 20:23:00.711227271 +0000 UTC m=+187.157809488" watchObservedRunningTime="2026-05-20 20:23:00.711558681 +0000 UTC m=+187.158140897"
May 20 20:23:03.704256 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:03.704224    2575 generic.go:358] "Generic (PLEG): container finished" podID="71a1bb4a-1c4c-46a6-81d3-8be34209d4a3" containerID="fe909e2a957fc6911555b1dd5371245753e367c45dcb9f095aafb92b51ec8c12" exitCode=255
May 20 20:23:03.704620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:03.704277    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk" event={"ID":"71a1bb4a-1c4c-46a6-81d3-8be34209d4a3","Type":"ContainerDied","Data":"fe909e2a957fc6911555b1dd5371245753e367c45dcb9f095aafb92b51ec8c12"}
May 20 20:23:03.709739 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:03.709723    2575 scope.go:117] "RemoveContainer" containerID="fe909e2a957fc6911555b1dd5371245753e367c45dcb9f095aafb92b51ec8c12"
May 20 20:23:04.707780 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:04.707744    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f7c5d4ff8-wc7gk" event={"ID":"71a1bb4a-1c4c-46a6-81d3-8be34209d4a3","Type":"ContainerStarted","Data":"5b6fcf74c22d5c9b93cf733c7f5d38d4de2584398bc6cc11b60f15cf40e8b1e7"}
May 20 20:23:05.806342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.806308    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"]
May 20 20:23:05.809559 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.809542    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:05.811832 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.811813    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 20 20:23:05.812615 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.812591    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 20 20:23:05.812714 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.812635    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vgwtn\""
May 20 20:23:05.812714 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.812636    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 20 20:23:05.814872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.814852    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"]
May 20 20:23:05.817824 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.817787    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:05.819559 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.819537    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kxhxr"]
May 20 20:23:05.819970 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.819950    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 20 20:23:05.820209 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.820175    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 20 20:23:05.820474 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.820459    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bn2pz\""
May 20 20:23:05.820551 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.820516    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 20 20:23:05.822754 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.822736    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"]
May 20 20:23:05.822901 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.822855    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:05.824987 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.824923    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 20 20:23:05.825101 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.825004    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 20 20:23:05.825101 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.825039    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 20 20:23:05.825249 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.825140    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t9tjz\""
May 20 20:23:05.829063 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.829035    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"]
May 20 20:23:05.977612 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:05.977791 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977630    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-wtmp\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:05.977791 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:05.977791 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k2ct\" (UniqueName: \"kubernetes.io/projected/12d271c1-d1d8-4666-a488-8a1bd9660958-kube-api-access-4k2ct\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:05.977913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjtbq\" (UniqueName: \"kubernetes.io/projected/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-api-access-rjtbq\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:05.977913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvht2\" (UniqueName: \"kubernetes.io/projected/83ab18cb-572d-4d9f-94cc-fad361d991ce-kube-api-access-dvht2\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:05.977913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d271c1-d1d8-4666-a488-8a1bd9660958-sys\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:05.977913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:05.977913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977894    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-tls\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:05.977913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977909    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:05.978133 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12d271c1-d1d8-4666-a488-8a1bd9660958-root\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:05.978133 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:05.978133 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.977977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83ab18cb-572d-4d9f-94cc-fad361d991ce-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:05.978133 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.978034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83ab18cb-572d-4d9f-94cc-fad361d991ce-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:05.978133 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.978065    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12d271c1-d1d8-4666-a488-8a1bd9660958-metrics-client-ca\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:05.978133 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.978083    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/83ab18cb-572d-4d9f-94cc-fad361d991ce-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:05.978133 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.978113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-textfile\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:05.978405 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.978146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:05.978405 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:05.978166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.079251 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079170    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.079251 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079231    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4k2ct\" (UniqueName: \"kubernetes.io/projected/12d271c1-d1d8-4666-a488-8a1bd9660958-kube-api-access-4k2ct\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.079466 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079259    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjtbq\" (UniqueName: \"kubernetes.io/projected/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-api-access-rjtbq\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.079466 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079278    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvht2\" (UniqueName: \"kubernetes.io/projected/83ab18cb-572d-4d9f-94cc-fad361d991ce-kube-api-access-dvht2\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:06.079466 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079303    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d271c1-d1d8-4666-a488-8a1bd9660958-sys\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.079466 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079323    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.079466 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079354    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-tls\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.079466 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079393    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d271c1-d1d8-4666-a488-8a1bd9660958-sys\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.079466 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079463    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.079769 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079495    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12d271c1-d1d8-4666-a488-8a1bd9660958-root\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.079769 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079516    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.079769 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079534    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83ab18cb-572d-4d9f-94cc-fad361d991ce-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:06.079769 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079562    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83ab18cb-572d-4d9f-94cc-fad361d991ce-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:06.079769 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:23:06.079565    2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 20 20:23:06.079769 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079577    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.079769 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079596    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12d271c1-d1d8-4666-a488-8a1bd9660958-root\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.079769 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:23:06.079645    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-tls podName:4577d96d-dca9-4b87-a7df-7cb08fbc7bba nodeName:}" failed. No retries permitted until 2026-05-20 20:23:06.579624965 +0000 UTC m=+193.026207179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-wxhtn" (UID: "4577d96d-dca9-4b87-a7df-7cb08fbc7bba") : secret "kube-state-metrics-tls" not found
May 20 20:23:06.079769 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079708    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12d271c1-d1d8-4666-a488-8a1bd9660958-metrics-client-ca\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.079769 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:23:06.079740    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 20 20:23:06.080293 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:23:06.079802    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-tls podName:12d271c1-d1d8-4666-a488-8a1bd9660958 nodeName:}" failed. No retries permitted until 2026-05-20 20:23:06.579786155 +0000 UTC m=+193.026368350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-tls") pod "node-exporter-kxhxr" (UID: "12d271c1-d1d8-4666-a488-8a1bd9660958") : secret "node-exporter-tls" not found
May 20 20:23:06.080293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079743    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/83ab18cb-572d-4d9f-94cc-fad361d991ce-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:06.080293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079864    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-textfile\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.080293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079914    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.080293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.079955    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.080293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.080002    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.080293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.080042    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-wtmp\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.080293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.080144    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.080293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.080243    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-wtmp\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.080293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.080256    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.080879 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.080364    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83ab18cb-572d-4d9f-94cc-fad361d991ce-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:06.080879 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.080364    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-textfile\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.080879 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.080812    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.080879 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.080851    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12d271c1-d1d8-4666-a488-8a1bd9660958-metrics-client-ca\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.082244 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.082217    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/83ab18cb-572d-4d9f-94cc-fad361d991ce-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:06.082244 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.082235    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83ab18cb-572d-4d9f-94cc-fad361d991ce-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:06.082651 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.082634    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.082871 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.082852    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.087394 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.087371    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k2ct\" (UniqueName: \"kubernetes.io/projected/12d271c1-d1d8-4666-a488-8a1bd9660958-kube-api-access-4k2ct\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.087531 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.087515    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjtbq\" (UniqueName: \"kubernetes.io/projected/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-api-access-rjtbq\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.087931 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.087912    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvht2\" (UniqueName: \"kubernetes.io/projected/83ab18cb-572d-4d9f-94cc-fad361d991ce-kube-api-access-dvht2\") pod \"openshift-state-metrics-9c959559f-rtb5v\" (UID: \"83ab18cb-572d-4d9f-94cc-fad361d991ce\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:06.118680 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.118651    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"
May 20 20:23:06.240167 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.240131    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v"]
May 20 20:23:06.243450 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:23:06.243423    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ab18cb_572d_4d9f_94cc_fad361d991ce.slice/crio-da63e8d4db6ecb330783c238e5702d2dce77ae3b62ba8252f60c67065908b036 WatchSource:0}: Error finding container da63e8d4db6ecb330783c238e5702d2dce77ae3b62ba8252f60c67065908b036: Status 404 returned error can't find the container with id da63e8d4db6ecb330783c238e5702d2dce77ae3b62ba8252f60c67065908b036
May 20 20:23:06.585596 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.585509    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-tls\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.585596 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.585550    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.587801 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.587777    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12d271c1-d1d8-4666-a488-8a1bd9660958-node-exporter-tls\") pod \"node-exporter-kxhxr\" (UID: \"12d271c1-d1d8-4666-a488-8a1bd9660958\") " pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.587982 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.587964    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4577d96d-dca9-4b87-a7df-7cb08fbc7bba-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-wxhtn\" (UID: \"4577d96d-dca9-4b87-a7df-7cb08fbc7bba\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.713675 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.713631    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v" event={"ID":"83ab18cb-572d-4d9f-94cc-fad361d991ce","Type":"ContainerStarted","Data":"bad654d7ca28c7f7a0e2dfef52fe3cfc2444784bf07d875b090969d87a406028"}
May 20 20:23:06.713675 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.713673    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v" event={"ID":"83ab18cb-572d-4d9f-94cc-fad361d991ce","Type":"ContainerStarted","Data":"6570777fb158aeab31e51c0584bf9eb57cbe3de1a10af13c319848bbd79c40f9"}
May 20 20:23:06.713850 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.713690    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v" event={"ID":"83ab18cb-572d-4d9f-94cc-fad361d991ce","Type":"ContainerStarted","Data":"da63e8d4db6ecb330783c238e5702d2dce77ae3b62ba8252f60c67065908b036"}
May 20 20:23:06.727851 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.727822    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"
May 20 20:23:06.733413 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.733390    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kxhxr"
May 20 20:23:06.741438 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:23:06.741410    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d271c1_d1d8_4666_a488_8a1bd9660958.slice/crio-b233a7f62fe04ae3a6b6ea5f456df9a8840114a025a0f14e44799c11ecde2ec7 WatchSource:0}: Error finding container b233a7f62fe04ae3a6b6ea5f456df9a8840114a025a0f14e44799c11ecde2ec7: Status 404 returned error can't find the container with id b233a7f62fe04ae3a6b6ea5f456df9a8840114a025a0f14e44799c11ecde2ec7
May 20 20:23:06.859978 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:06.859898    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn"]
May 20 20:23:06.862561 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:23:06.862530    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4577d96d_dca9_4b87_a7df_7cb08fbc7bba.slice/crio-00cf60a1b147ecf9cbe57af986dea5d1df1167bbfff59b1650a108bdae6df180 WatchSource:0}: Error finding container 00cf60a1b147ecf9cbe57af986dea5d1df1167bbfff59b1650a108bdae6df180: Status 404 returned error can't find the container with id 00cf60a1b147ecf9cbe57af986dea5d1df1167bbfff59b1650a108bdae6df180
May 20 20:23:07.719581 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:07.719491    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v" event={"ID":"83ab18cb-572d-4d9f-94cc-fad361d991ce","Type":"ContainerStarted","Data":"e5c2a3c96d66f12841398f68db4a4c959b3a055fe31d4d4297c517dc64580d6c"}
May 20 20:23:07.720856 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:07.720808    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxhxr" event={"ID":"12d271c1-d1d8-4666-a488-8a1bd9660958","Type":"ContainerStarted","Data":"b233a7f62fe04ae3a6b6ea5f456df9a8840114a025a0f14e44799c11ecde2ec7"}
May 20 20:23:07.721945 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:07.721914    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn" event={"ID":"4577d96d-dca9-4b87-a7df-7cb08fbc7bba","Type":"ContainerStarted","Data":"00cf60a1b147ecf9cbe57af986dea5d1df1167bbfff59b1650a108bdae6df180"}
May 20 20:23:07.741946 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:07.741887    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-rtb5v" podStartSLOduration=1.71292588 podStartE2EDuration="2.741868854s" podCreationTimestamp="2026-05-20 20:23:05 +0000 UTC" firstStartedPulling="2026-05-20 20:23:06.362284223 +0000 UTC m=+192.808866433" lastFinishedPulling="2026-05-20 20:23:07.391227199 +0000 UTC m=+193.837809407" observedRunningTime="2026-05-20 20:23:07.739614796 +0000 UTC m=+194.186197013" watchObservedRunningTime="2026-05-20 20:23:07.741868854 +0000 UTC m=+194.188451074"
May 20 20:23:08.726366 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.726328    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn" event={"ID":"4577d96d-dca9-4b87-a7df-7cb08fbc7bba","Type":"ContainerStarted","Data":"27119ba7502acbfb1c8de4a0c192b5a53249e2259ebb67601f87c21534b63d4c"}
May 20 20:23:08.726846 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.726373    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn" event={"ID":"4577d96d-dca9-4b87-a7df-7cb08fbc7bba","Type":"ContainerStarted","Data":"fca7ac09e9a7fab85aeda49462ef534db4db2a4190f724b0609aa90c3d2df265"}
May 20 20:23:08.726846 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.726390    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn" event={"ID":"4577d96d-dca9-4b87-a7df-7cb08fbc7bba","Type":"ContainerStarted","Data":"9fa7bccdb4fddfb262c0b9e821ca0703707483f67121e5a7ed0dd27ae98eb754"}
May 20 20:23:08.727671 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.727650    2575 generic.go:358] "Generic (PLEG): container finished" podID="12d271c1-d1d8-4666-a488-8a1bd9660958" containerID="00cab653f528e3343a2005da84c13b7ee6e6c5ae581a54791707cabcacfa6423" exitCode=0
May 20 20:23:08.727756 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.727735    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxhxr" event={"ID":"12d271c1-d1d8-4666-a488-8a1bd9660958","Type":"ContainerDied","Data":"00cab653f528e3343a2005da84c13b7ee6e6c5ae581a54791707cabcacfa6423"}
May 20 20:23:08.746550 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.746505    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-wxhtn" podStartSLOduration=2.349603177 podStartE2EDuration="3.746481064s" podCreationTimestamp="2026-05-20 20:23:05 +0000 UTC" firstStartedPulling="2026-05-20 20:23:06.864647345 +0000 UTC m=+193.311229558" lastFinishedPulling="2026-05-20 20:23:08.26152525 +0000 UTC m=+194.708107445" observedRunningTime="2026-05-20 20:23:08.745172429 +0000 UTC m=+195.191754647" watchObservedRunningTime="2026-05-20 20:23:08.746481064 +0000 UTC m=+195.193063281"
May 20 20:23:08.886591 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.886559    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5957879bcd-4krdb"]
May 20 20:23:08.890335 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.890315    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:08.892923 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.892900    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 20 20:23:08.893053 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.892907    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tvx9m\""
May 20 20:23:08.893053 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.892979    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 20 20:23:08.893053 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.893003    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 20 20:23:08.893053 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.893003    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 20 20:23:08.893374 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.893360    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-67jherd5jctlk\""
May 20 20:23:08.893431 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.893415    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 20 20:23:08.900135 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:08.900115    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5957879bcd-4krdb"]
May 20 20:23:09.007711 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.007622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-tls\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.007711 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.007677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.007896 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.007731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.007896 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.007770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-grpc-tls\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.007896 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.007794    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78pgd\" (UniqueName: \"kubernetes.io/projected/12fd368d-0a3f-4b33-8746-c6cb09bbee32-kube-api-access-78pgd\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.007896 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.007814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.007896 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.007834    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.007896 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.007849    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12fd368d-0a3f-4b33-8746-c6cb09bbee32-metrics-client-ca\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.108978 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.108943    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-tls\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.109153 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.109000    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.109153 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.109040    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.109153 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.109083    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-grpc-tls\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.109153 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.109126    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78pgd\" (UniqueName: \"kubernetes.io/projected/12fd368d-0a3f-4b33-8746-c6cb09bbee32-kube-api-access-78pgd\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.109334 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.109256    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.109334 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.109316    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.109407 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.109346    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12fd368d-0a3f-4b33-8746-c6cb09bbee32-metrics-client-ca\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.110118 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.110089    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12fd368d-0a3f-4b33-8746-c6cb09bbee32-metrics-client-ca\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.111721 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.111693    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.111823 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.111763    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-tls\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.111998 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.111977    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.112111 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.112088    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.112177 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.112159    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-grpc-tls\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.112418 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.112403    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12fd368d-0a3f-4b33-8746-c6cb09bbee32-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.117981 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.117960    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78pgd\" (UniqueName: \"kubernetes.io/projected/12fd368d-0a3f-4b33-8746-c6cb09bbee32-kube-api-access-78pgd\") pod \"thanos-querier-5957879bcd-4krdb\" (UID: \"12fd368d-0a3f-4b33-8746-c6cb09bbee32\") " pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.139349 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.139324    2575 scope.go:117] "RemoveContainer" containerID="54ba195f2ea114fd1284bf2623e9e1c2c35644172221f37a829da2016db90cb1"
May 20 20:23:09.139517 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:23:09.139500    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-252gl_openshift-console-operator(26c57738-105f-421c-82aa-1261642326be)\"" pod="openshift-console-operator/console-operator-76dff48d59-252gl" podUID="26c57738-105f-421c-82aa-1261642326be"
May 20 20:23:09.200322 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.200285    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:09.327849 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.327821    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5957879bcd-4krdb"]
May 20 20:23:09.330735 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:23:09.330706    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fd368d_0a3f_4b33_8746_c6cb09bbee32.slice/crio-16aea86a151d6d32e9191eee48e992031a8c4d238915b15d995afced0a1699d0 WatchSource:0}: Error finding container 16aea86a151d6d32e9191eee48e992031a8c4d238915b15d995afced0a1699d0: Status 404 returned error can't find the container with id 16aea86a151d6d32e9191eee48e992031a8c4d238915b15d995afced0a1699d0
May 20 20:23:09.732416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.732376    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxhxr" event={"ID":"12d271c1-d1d8-4666-a488-8a1bd9660958","Type":"ContainerStarted","Data":"503eaceb1d54ffc3fe7fbd40f27ab92fc85baab39c8f44e0633e533be25fafbd"}
May 20 20:23:09.732416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.732417    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxhxr" event={"ID":"12d271c1-d1d8-4666-a488-8a1bd9660958","Type":"ContainerStarted","Data":"21ccba52c8b5c04b98029c68daa77b03f6209d7a848d20c25bf26238a7d21796"}
May 20 20:23:09.733435 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.733408    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb" event={"ID":"12fd368d-0a3f-4b33-8746-c6cb09bbee32","Type":"ContainerStarted","Data":"16aea86a151d6d32e9191eee48e992031a8c4d238915b15d995afced0a1699d0"}
May 20 20:23:09.751299 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:09.751255    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kxhxr" podStartSLOduration=3.23489452 podStartE2EDuration="4.751241918s" podCreationTimestamp="2026-05-20 20:23:05 +0000 UTC" firstStartedPulling="2026-05-20 20:23:06.742989401 +0000 UTC m=+193.189571595" lastFinishedPulling="2026-05-20 20:23:08.259336795 +0000 UTC m=+194.705918993" observedRunningTime="2026-05-20 20:23:09.750914974 +0000 UTC m=+196.197497193" watchObservedRunningTime="2026-05-20 20:23:09.751241918 +0000 UTC m=+196.197824137"
May 20 20:23:10.107626 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.107555    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7687886c84-fzgd5"]
May 20 20:23:10.111034 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.111014    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.113323 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.113280    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7g4d4\""
May 20 20:23:10.113323 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.113295    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 20 20:23:10.113473 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.113288    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 20 20:23:10.114270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.114252    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 20 20:23:10.114374 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.114256    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 20 20:23:10.114374 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.114327    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2kj0b31l00brv\""
May 20 20:23:10.118746 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.118726    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7687886c84-fzgd5"]
May 20 20:23:10.218291 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.218252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-client-ca-bundle\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.218467 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.218349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.218467 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.218381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm9sx\" (UniqueName: \"kubernetes.io/projected/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-kube-api-access-gm9sx\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.218588 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.218491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-secret-metrics-server-tls\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.218588 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.218532    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-metrics-server-audit-profiles\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.218588 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.218564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-audit-log\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.218710 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.218612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-secret-metrics-server-client-certs\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.319512 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.319476    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-secret-metrics-server-tls\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.319512 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.319515    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-metrics-server-audit-profiles\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.319685 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.319534    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-audit-log\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.319685 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.319580    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-secret-metrics-server-client-certs\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.319766 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.319745    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-client-ca-bundle\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.319819 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.319798    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.319870 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.319827    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gm9sx\" (UniqueName: \"kubernetes.io/projected/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-kube-api-access-gm9sx\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.320281 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.319972    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-audit-log\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.320619 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.320592    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-metrics-server-audit-profiles\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.320805 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.320782    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.322344 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.322323    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-secret-metrics-server-tls\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.322415 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.322388    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-secret-metrics-server-client-certs\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.322594 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.322575    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-client-ca-bundle\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.327353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.327331    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm9sx\" (UniqueName: \"kubernetes.io/projected/d31da29a-e7d6-4d9a-a2ac-8e46fd38c545-kube-api-access-gm9sx\") pod \"metrics-server-7687886c84-fzgd5\" (UID: \"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545\") " pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.422873 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.422824    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:10.555977 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:10.555943    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7687886c84-fzgd5"]
May 20 20:23:11.004959 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:23:11.004923    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31da29a_e7d6_4d9a_a2ac_8e46fd38c545.slice/crio-fb536a68ec7281f0d8eba23411a4117a66134644cdcf4262b19d17f290aef63e WatchSource:0}: Error finding container fb536a68ec7281f0d8eba23411a4117a66134644cdcf4262b19d17f290aef63e: Status 404 returned error can't find the container with id fb536a68ec7281f0d8eba23411a4117a66134644cdcf4262b19d17f290aef63e
May 20 20:23:11.740806 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:11.740755    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7687886c84-fzgd5" event={"ID":"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545","Type":"ContainerStarted","Data":"fb536a68ec7281f0d8eba23411a4117a66134644cdcf4262b19d17f290aef63e"}
May 20 20:23:11.742879 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:11.742851    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb" event={"ID":"12fd368d-0a3f-4b33-8746-c6cb09bbee32","Type":"ContainerStarted","Data":"4569fdc355f8a7d1f522ca09a64a1b1abfc450334c5f5cd3b64ba98f1491061f"}
May 20 20:23:11.743010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:11.742885    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb" event={"ID":"12fd368d-0a3f-4b33-8746-c6cb09bbee32","Type":"ContainerStarted","Data":"a30e6b2dd8a40602a7f1c80d0b54e4a59e0ba00989343e2fbc79b743072b5604"}
May 20 20:23:11.743010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:11.742898    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb" event={"ID":"12fd368d-0a3f-4b33-8746-c6cb09bbee32","Type":"ContainerStarted","Data":"125caf8e84dc6017639aceecf3cfbe05ac067051ef65164b2f036c7bb9e1118d"}
May 20 20:23:11.789754 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:11.789715    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:23:11.789920 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:11.789782    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:23:12.024016 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.023985    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:23:12.028156 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.028133    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.030970 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.030748    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 20 20:23:12.030970 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.030859    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 20 20:23:12.030970 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.030883    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 20 20:23:12.031359 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.031126    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h42hc\""
May 20 20:23:12.031359 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.031156    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 20 20:23:12.031686 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.031617    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 20 20:23:12.031686 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.031682    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 20 20:23:12.032317 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.031925    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-35solf4u9651p\""
May 20 20:23:12.032317 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.031959    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 20 20:23:12.032317 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.031995    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 20 20:23:12.032768 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.032627    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 20 20:23:12.032906 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.032853    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 20 20:23:12.035261 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.035243    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 20 20:23:12.037268 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.037248    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 20 20:23:12.042342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.042319    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:23:12.137161 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137120    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137331 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137331 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137331 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137490 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137357    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137490 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137399    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137574 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137630 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137630 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4qzt\" (UniqueName: \"kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-kube-api-access-c4qzt\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137708 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137708 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137708 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137708 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137880 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137732    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137880 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137880 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137857    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137992 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137898    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.137992 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.137924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.238609 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.238565    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.238794 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.238631    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.238794 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.238660    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.238794 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.238687    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.238794 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.238714    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239018 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.238862    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239018 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.238930    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239018 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.238958    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239018 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.238992    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239245 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239084    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239245 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239111    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239245 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239139    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c4qzt\" (UniqueName: \"kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-kube-api-access-c4qzt\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239245 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239167    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239245 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239208    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239245 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239237    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239538 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239275    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239538 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239310    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239538 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239355    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239685 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239556    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.239775 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239752    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.240356 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.239945    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.240356 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.240022    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.240580 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.240358    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.242475 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.242130    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.242475 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.242185    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.242475 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.242328    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.243262 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.242935    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.243262 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.243106    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.243415 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.243392    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.244221 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.244157    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.244509 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.244475    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.244822 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.244800    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.245271 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.245250    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.245346 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.245321    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.246098 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.246073    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.248079 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.248052    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4qzt\" (UniqueName: \"kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-kube-api-access-c4qzt\") pod \"prometheus-k8s-0\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.341396 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.341317    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:12.536082 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.536044    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:23:12.539525 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:23:12.539494    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82006fe_f4f4_4a27_9be8_f1c656b8646d.slice/crio-b864711f43711669c20a4777ea9c27ec89c85b34dfc6e53ce3cd0fbbab7d1beb WatchSource:0}: Error finding container b864711f43711669c20a4777ea9c27ec89c85b34dfc6e53ce3cd0fbbab7d1beb: Status 404 returned error can't find the container with id b864711f43711669c20a4777ea9c27ec89c85b34dfc6e53ce3cd0fbbab7d1beb
May 20 20:23:12.747051 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.747011    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerStarted","Data":"b864711f43711669c20a4777ea9c27ec89c85b34dfc6e53ce3cd0fbbab7d1beb"}
May 20 20:23:12.748213 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.748166    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7687886c84-fzgd5" event={"ID":"d31da29a-e7d6-4d9a-a2ac-8e46fd38c545","Type":"ContainerStarted","Data":"7ace778462916c58cb7054ce9737182983482144ede043cd694d4472e015156b"}
May 20 20:23:12.750716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.750697    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb" event={"ID":"12fd368d-0a3f-4b33-8746-c6cb09bbee32","Type":"ContainerStarted","Data":"b6bb88f3aea7d1c330a6287d7d936ede97c31bce57ddf77be7403b2be3d1b371"}
May 20 20:23:12.750786 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.750719    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb" event={"ID":"12fd368d-0a3f-4b33-8746-c6cb09bbee32","Type":"ContainerStarted","Data":"564ddfe11e1d9fd9d82175b65fbd07513e3135baec77d7c9b0c0d253c2a864bf"}
May 20 20:23:12.750786 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.750728    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb" event={"ID":"12fd368d-0a3f-4b33-8746-c6cb09bbee32","Type":"ContainerStarted","Data":"b875201a2ec83ea07bed7bf82a6ccb75d84b2d0efe2bdb81b1d1e6196f14ad43"}
May 20 20:23:12.750920 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.750909    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:12.766588 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.766545    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7687886c84-fzgd5" podStartSLOduration=1.320631646 podStartE2EDuration="2.76653278s" podCreationTimestamp="2026-05-20 20:23:10 +0000 UTC" firstStartedPulling="2026-05-20 20:23:11.00676334 +0000 UTC m=+197.453345536" lastFinishedPulling="2026-05-20 20:23:12.452664471 +0000 UTC m=+198.899246670" observedRunningTime="2026-05-20 20:23:12.766056108 +0000 UTC m=+199.212638324" watchObservedRunningTime="2026-05-20 20:23:12.76653278 +0000 UTC m=+199.213114996"
May 20 20:23:12.787392 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:12.787345    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb" podStartSLOduration=2.246070878 podStartE2EDuration="4.787333956s" podCreationTimestamp="2026-05-20 20:23:08 +0000 UTC" firstStartedPulling="2026-05-20 20:23:09.332679002 +0000 UTC m=+195.779261197" lastFinishedPulling="2026-05-20 20:23:11.873942065 +0000 UTC m=+198.320524275" observedRunningTime="2026-05-20 20:23:12.786468066 +0000 UTC m=+199.233050284" watchObservedRunningTime="2026-05-20 20:23:12.787333956 +0000 UTC m=+199.233916174"
May 20 20:23:13.675347 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:13.675042    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:23:13.675347 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:13.675096    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:23:13.755453 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:13.755420    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerStarted","Data":"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"}
May 20 20:23:14.759499 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:14.759462    2575 generic.go:358] "Generic (PLEG): container finished" podID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerID="17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa" exitCode=0
May 20 20:23:14.759959 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:14.759547    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerDied","Data":"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"}
May 20 20:23:17.772960 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:17.772931    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerStarted","Data":"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"}
May 20 20:23:17.773304 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:17.772968    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerStarted","Data":"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"}
May 20 20:23:17.773304 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:17.772978    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerStarted","Data":"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"}
May 20 20:23:17.773304 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:17.772990    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerStarted","Data":"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"}
May 20 20:23:17.773304 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:17.772998    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerStarted","Data":"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"}
May 20 20:23:18.761405 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:18.761376    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5957879bcd-4krdb"
May 20 20:23:18.780201 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:18.780153    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerStarted","Data":"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"}
May 20 20:23:18.812774 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:18.812724    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.957077542 podStartE2EDuration="6.812707379s" podCreationTimestamp="2026-05-20 20:23:12 +0000 UTC" firstStartedPulling="2026-05-20 20:23:12.546244713 +0000 UTC m=+198.992826907" lastFinishedPulling="2026-05-20 20:23:17.401874541 +0000 UTC m=+203.848456744" observedRunningTime="2026-05-20 20:23:18.811145342 +0000 UTC m=+205.257727564" watchObservedRunningTime="2026-05-20 20:23:18.812707379 +0000 UTC m=+205.259289653"
May 20 20:23:21.789354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:21.789306    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:23:21.789724 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:21.789368    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:23:22.138904 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:22.138874    2575 scope.go:117] "RemoveContainer" containerID="54ba195f2ea114fd1284bf2623e9e1c2c35644172221f37a829da2016db90cb1"
May 20 20:23:22.342050 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:22.342012    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:23:22.794293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:22.794266    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:23:22.794644 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:22.794353    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-252gl" event={"ID":"26c57738-105f-421c-82aa-1261642326be","Type":"ContainerStarted","Data":"ea4f04d33922ff6ed32786cc0a1533983b4aac9c203581193340aff95faf597f"}
May 20 20:23:22.794644 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:22.794632    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:23:22.812725 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:22.812678    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-252gl" podStartSLOduration=57.413973609 podStartE2EDuration="59.812665736s" podCreationTimestamp="2026-05-20 20:22:23 +0000 UTC" firstStartedPulling="2026-05-20 20:22:24.118385863 +0000 UTC m=+150.564968059" lastFinishedPulling="2026-05-20 20:22:26.517077991 +0000 UTC m=+152.963660186" observedRunningTime="2026-05-20 20:23:22.811622568 +0000 UTC m=+209.258204785" watchObservedRunningTime="2026-05-20 20:23:22.812665736 +0000 UTC m=+209.259247953"
May 20 20:23:23.051001 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:23.050927    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-252gl"
May 20 20:23:23.673912 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:23.673882    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:23:23.674085 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:23.673931    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:23:30.422915 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:30.422877    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:30.422915 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:30.422922    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:31.788351 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:31.788320    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:23:31.788737 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:31.788369    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:23:31.788737 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:31.788407    2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:23:31.788879 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:31.788849    2575 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"ee3d9ae97d7a8dbf6464c3931fb827133427918a1a3eb4613d6870c32338cf63"} pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" containerMessage="Container registry failed liveness probe, will be restarted"
May 20 20:23:31.792597 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:31.792569    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:23:31.792742 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:31.792616    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:23:32.822408 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:32.822375    2575 generic.go:358] "Generic (PLEG): container finished" podID="64fcfcf2-5717-4003-9c9a-b10e5f4f7089" containerID="5cbe5d68e53d7cf0586e97ecce1e0b8ae7160c14001452320f9a5383d1672d08" exitCode=0
May 20 20:23:32.822772 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:32.822448    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7" event={"ID":"64fcfcf2-5717-4003-9c9a-b10e5f4f7089","Type":"ContainerDied","Data":"5cbe5d68e53d7cf0586e97ecce1e0b8ae7160c14001452320f9a5383d1672d08"}
May 20 20:23:32.822772 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:32.822762    2575 scope.go:117] "RemoveContainer" containerID="5cbe5d68e53d7cf0586e97ecce1e0b8ae7160c14001452320f9a5383d1672d08"
May 20 20:23:33.827799 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:33.827768    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-cpww7" event={"ID":"64fcfcf2-5717-4003-9c9a-b10e5f4f7089","Type":"ContainerStarted","Data":"b204fdf29a723560e20be248998db513d003d36786f08ec631d75384cafb4ba8"}
May 20 20:23:41.792855 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:41.792824    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:23:41.793267 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:41.792873    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:23:43.800246 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:43.800217    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z2rgw_a8afe344-be23-4700-9ff6-95fa7d945bd8/dns-node-resolver/0.log"
May 20 20:23:44.001336 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:44.001286    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d75bc698b-vhtbp_84386a5b-6b8a-45da-aa84-f6a252a57727/registry/0.log"
May 20 20:23:44.400020 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:44.399987    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dbzh4_159c1ebf-42c3-4fe7-b624-208c0435814d/node-ca/0.log"
May 20 20:23:50.429453 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:50.429423    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:50.433476 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:50.433452    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7687886c84-fzgd5"
May 20 20:23:51.792940 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:51.792900    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:23:51.793396 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:51.792973    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:23:56.807357 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:56.807301    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" containerID="cri-o://ee3d9ae97d7a8dbf6464c3931fb827133427918a1a3eb4613d6870c32338cf63" gracePeriod=30
May 20 20:23:58.900432 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:58.900394    2575 generic.go:358] "Generic (PLEG): container finished" podID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerID="ee3d9ae97d7a8dbf6464c3931fb827133427918a1a3eb4613d6870c32338cf63" exitCode=0
May 20 20:23:58.900815 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:58.900468    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" event={"ID":"84386a5b-6b8a-45da-aa84-f6a252a57727","Type":"ContainerDied","Data":"ee3d9ae97d7a8dbf6464c3931fb827133427918a1a3eb4613d6870c32338cf63"}
May 20 20:23:58.900815 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:58.900502    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" event={"ID":"84386a5b-6b8a-45da-aa84-f6a252a57727","Type":"ContainerStarted","Data":"492e03ff93f18593d509384788beda4b8ee6a719db2434085938de1245718f80"}
May 20 20:23:58.900815 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:23:58.900680    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:24:04.920547 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:04.920517    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:24:04.922817 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:04.922793    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b58b9421-7735-48d6-ae02-be449d7adfb9-metrics-certs\") pod \"network-metrics-daemon-5rhth\" (UID: \"b58b9421-7735-48d6-ae02-be449d7adfb9\") " pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:24:05.041926 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:05.041895    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qsfbr\""
May 20 20:24:05.050050 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:05.050032    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhth"
May 20 20:24:05.172520 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:05.172440    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rhth"]
May 20 20:24:05.175872 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:24:05.175845    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58b9421_7735_48d6_ae02_be449d7adfb9.slice/crio-794d1923c8d66c079a380639edf45cc1a27ddeef09e3666066ed61a4b12dcbd2 WatchSource:0}: Error finding container 794d1923c8d66c079a380639edf45cc1a27ddeef09e3666066ed61a4b12dcbd2: Status 404 returned error can't find the container with id 794d1923c8d66c079a380639edf45cc1a27ddeef09e3666066ed61a4b12dcbd2
May 20 20:24:05.919579 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:05.919545    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rhth" event={"ID":"b58b9421-7735-48d6-ae02-be449d7adfb9","Type":"ContainerStarted","Data":"794d1923c8d66c079a380639edf45cc1a27ddeef09e3666066ed61a4b12dcbd2"}
May 20 20:24:06.924441 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:06.924405    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rhth" event={"ID":"b58b9421-7735-48d6-ae02-be449d7adfb9","Type":"ContainerStarted","Data":"2f04ecb975821aff61044213fc6b301ceee7323f502e537dab75fb4c0fead308"}
May 20 20:24:06.924441 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:06.924446    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rhth" event={"ID":"b58b9421-7735-48d6-ae02-be449d7adfb9","Type":"ContainerStarted","Data":"504dfec916e1dfc58aeea08b60a771fdc539580d9e2dddd2e2b950da497e23ae"}
May 20 20:24:06.946586 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:06.944043    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5rhth" podStartSLOduration=251.985181383 podStartE2EDuration="4m12.944023752s" podCreationTimestamp="2026-05-20 20:19:54 +0000 UTC" firstStartedPulling="2026-05-20 20:24:05.177756522 +0000 UTC m=+251.624338720" lastFinishedPulling="2026-05-20 20:24:06.136598879 +0000 UTC m=+252.583181089" observedRunningTime="2026-05-20 20:24:06.940969645 +0000 UTC m=+253.387551862" watchObservedRunningTime="2026-05-20 20:24:06.944023752 +0000 UTC m=+253.390605969"
May 20 20:24:11.789603 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:11.789573    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:24:11.789948 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:11.789629    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:24:12.342484 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:12.342443    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:12.361824 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:12.361792    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:12.957328 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:12.957297    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:19.907654 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:19.907573    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:24:19.908021 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:19.907650    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:24:21.788411 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:21.788380    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:24:21.788787 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:21.788430    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:24:29.907627 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:29.907594    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:24:29.908023 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:29.907646    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:24:30.389630 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.389590    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:24:30.390083 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.390048    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="prometheus" containerID="cri-o://a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238" gracePeriod=600
May 20 20:24:30.390243 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.390083    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="config-reloader" containerID="cri-o://e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37" gracePeriod=600
May 20 20:24:30.390243 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.390099    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="thanos-sidecar" containerID="cri-o://415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b" gracePeriod=600
May 20 20:24:30.390243 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.390061    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy" containerID="cri-o://77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5" gracePeriod=600
May 20 20:24:30.390243 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.390126    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy-web" containerID="cri-o://92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467" gracePeriod=600
May 20 20:24:30.390243 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.390178    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea" gracePeriod=600
May 20 20:24:30.623318 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.623294    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:30.745845 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.745761    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config-out\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.745845 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.745797    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-serving-certs-ca-bundle\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.745845 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.745824    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-db\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.745845 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.745845    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-tls-assets\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746164 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.745867    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-kubelet-serving-ca-bundle\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746164 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.745882    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-rulefiles-0\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746164 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.745909    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746164 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.745939    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-grpc-tls\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746164 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.745969    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-metrics-client-certs\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746164 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746002    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-metrics-client-ca\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746164 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746027    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-kube-rbac-proxy\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746164 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746063    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746164 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746106    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-web-config\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746164 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746146    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-thanos-prometheus-http-client-file\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746661 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746172    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4qzt\" (UniqueName: \"kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-kube-api-access-c4qzt\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746661 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746227    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-tls\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746661 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746254    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746661 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746287    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-trusted-ca-bundle\") pod \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\" (UID: \"a82006fe-f4f4-4a27-9be8-f1c656b8646d\") "
May 20 20:24:30.746661 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746365    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:24:30.746661 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746608    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.746958 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.746557    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:24:30.747121 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.747012    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:24:30.747379 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.747350    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:24:30.747603 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.747576    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:24:30.748896 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.748850    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 20:24:30.748996 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.748925    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config-out" (OuterVolumeSpecName: "config-out") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:24:30.749213 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.749169    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:30.749298 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.749271    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-kube-api-access-c4qzt" (OuterVolumeSpecName: "kube-api-access-c4qzt") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "kube-api-access-c4qzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:24:30.749482 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.749451    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:24:30.749958 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.749924    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:30.750068 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.750044    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:30.750263 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.750239    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:30.750717 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.750693    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config" (OuterVolumeSpecName: "config") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:30.750814 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.750730    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:30.751441 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.751417    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:30.751500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.751450    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:30.760822 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.760803    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-web-config" (OuterVolumeSpecName: "web-config") pod "a82006fe-f4f4-4a27-9be8-f1c656b8646d" (UID: "a82006fe-f4f4-4a27-9be8-f1c656b8646d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:24:30.847888 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847858    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-web-config\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.847888 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847884    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.847888 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847894    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4qzt\" (UniqueName: \"kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-kube-api-access-c4qzt\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847905    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847914    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847924    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847933    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config-out\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847941    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847950    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-db\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847959    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a82006fe-f4f4-4a27-9be8-f1c656b8646d-tls-assets\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847968    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847976    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847985    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-grpc-tls\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.847993    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-metrics-client-certs\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.848001    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a82006fe-f4f4-4a27-9be8-f1c656b8646d-configmap-metrics-client-ca\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.848009    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-secret-kube-rbac-proxy\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.848114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.848019    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a82006fe-f4f4-4a27-9be8-f1c656b8646d-config\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:24:30.995754 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995716    2575 generic.go:358] "Generic (PLEG): container finished" podID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerID="b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea" exitCode=0
May 20 20:24:30.995754 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995746    2575 generic.go:358] "Generic (PLEG): container finished" podID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerID="77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5" exitCode=0
May 20 20:24:30.995754 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995754    2575 generic.go:358] "Generic (PLEG): container finished" podID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerID="92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467" exitCode=0
May 20 20:24:30.995754 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995759    2575 generic.go:358] "Generic (PLEG): container finished" podID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerID="415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b" exitCode=0
May 20 20:24:30.995754 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995764    2575 generic.go:358] "Generic (PLEG): container finished" podID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerID="e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37" exitCode=0
May 20 20:24:30.996416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995769    2575 generic.go:358] "Generic (PLEG): container finished" podID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerID="a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238" exitCode=0
May 20 20:24:30.996416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995808    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerDied","Data":"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"}
May 20 20:24:30.996416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995848    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerDied","Data":"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"}
May 20 20:24:30.996416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995854    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:30.996416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995862    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerDied","Data":"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"}
May 20 20:24:30.996416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995873    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerDied","Data":"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"}
May 20 20:24:30.996416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995882    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerDied","Data":"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"}
May 20 20:24:30.996416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995892    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerDied","Data":"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"}
May 20 20:24:30.996416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995901    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a82006fe-f4f4-4a27-9be8-f1c656b8646d","Type":"ContainerDied","Data":"b864711f43711669c20a4777ea9c27ec89c85b34dfc6e53ce3cd0fbbab7d1beb"}
May 20 20:24:30.996416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:30.995916    2575 scope.go:117] "RemoveContainer" containerID="b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"
May 20 20:24:31.004083 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.004063    2575 scope.go:117] "RemoveContainer" containerID="77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"
May 20 20:24:31.010813 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.010796    2575 scope.go:117] "RemoveContainer" containerID="92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"
May 20 20:24:31.017333 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.017309    2575 scope.go:117] "RemoveContainer" containerID="415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"
May 20 20:24:31.019342 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.019308    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:24:31.023700 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.023680    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:24:31.025254 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.025235    2575 scope.go:117] "RemoveContainer" containerID="e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"
May 20 20:24:31.031556 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.031537    2575 scope.go:117] "RemoveContainer" containerID="a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"
May 20 20:24:31.038420 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.038403    2575 scope.go:117] "RemoveContainer" containerID="17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"
May 20 20:24:31.045317 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.045301    2575 scope.go:117] "RemoveContainer" containerID="b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"
May 20 20:24:31.045587 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:24:31.045569    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": container with ID starting with b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea not found: ID does not exist" containerID="b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"
May 20 20:24:31.045627 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.045596    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"} err="failed to get container status \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": rpc error: code = NotFound desc = could not find container \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": container with ID starting with b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea not found: ID does not exist"
May 20 20:24:31.045627 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.045614    2575 scope.go:117] "RemoveContainer" containerID="77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"
May 20 20:24:31.045796 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:24:31.045781    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": container with ID starting with 77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5 not found: ID does not exist" containerID="77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"
May 20 20:24:31.045831 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.045800    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"} err="failed to get container status \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": rpc error: code = NotFound desc = could not find container \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": container with ID starting with 77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5 not found: ID does not exist"
May 20 20:24:31.045831 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.045812    2575 scope.go:117] "RemoveContainer" containerID="92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"
May 20 20:24:31.045979 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:24:31.045965    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": container with ID starting with 92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467 not found: ID does not exist" containerID="92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"
May 20 20:24:31.046017 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.045982    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"} err="failed to get container status \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": rpc error: code = NotFound desc = could not find container \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": container with ID starting with 92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467 not found: ID does not exist"
May 20 20:24:31.046017 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.045994    2575 scope.go:117] "RemoveContainer" containerID="415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"
May 20 20:24:31.046184 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:24:31.046161    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": container with ID starting with 415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b not found: ID does not exist" containerID="415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"
May 20 20:24:31.046295 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.046209    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"} err="failed to get container status \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": rpc error: code = NotFound desc = could not find container \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": container with ID starting with 415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b not found: ID does not exist"
May 20 20:24:31.046295 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.046229    2575 scope.go:117] "RemoveContainer" containerID="e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"
May 20 20:24:31.046478 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:24:31.046464    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": container with ID starting with e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37 not found: ID does not exist" containerID="e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"
May 20 20:24:31.046522 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.046483    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"} err="failed to get container status \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": rpc error: code = NotFound desc = could not find container \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": container with ID starting with e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37 not found: ID does not exist"
May 20 20:24:31.046522 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.046494    2575 scope.go:117] "RemoveContainer" containerID="a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"
May 20 20:24:31.046707 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:24:31.046692    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": container with ID starting with a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238 not found: ID does not exist" containerID="a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"
May 20 20:24:31.046744 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.046713    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"} err="failed to get container status \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": rpc error: code = NotFound desc = could not find container \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": container with ID starting with a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238 not found: ID does not exist"
May 20 20:24:31.046744 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.046726    2575 scope.go:117] "RemoveContainer" containerID="17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"
May 20 20:24:31.046939 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:24:31.046922    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": container with ID starting with 17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa not found: ID does not exist" containerID="17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"
May 20 20:24:31.046976 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.046945    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"} err="failed to get container status \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": rpc error: code = NotFound desc = could not find container \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": container with ID starting with 17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa not found: ID does not exist"
May 20 20:24:31.046976 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.046960    2575 scope.go:117] "RemoveContainer" containerID="b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"
May 20 20:24:31.047416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.047313    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"} err="failed to get container status \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": rpc error: code = NotFound desc = could not find container \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": container with ID starting with b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea not found: ID does not exist"
May 20 20:24:31.047416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.047340    2575 scope.go:117] "RemoveContainer" containerID="77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"
May 20 20:24:31.048162 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.047671    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"} err="failed to get container status \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": rpc error: code = NotFound desc = could not find container \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": container with ID starting with 77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5 not found: ID does not exist"
May 20 20:24:31.048162 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.047695    2575 scope.go:117] "RemoveContainer" containerID="92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"
May 20 20:24:31.048162 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.047925    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"} err="failed to get container status \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": rpc error: code = NotFound desc = could not find container \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": container with ID starting with 92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467 not found: ID does not exist"
May 20 20:24:31.048162 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.047941    2575 scope.go:117] "RemoveContainer" containerID="415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"
May 20 20:24:31.048543 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.048515    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"} err="failed to get container status \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": rpc error: code = NotFound desc = could not find container \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": container with ID starting with 415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b not found: ID does not exist"
May 20 20:24:31.048654 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.048544    2575 scope.go:117] "RemoveContainer" containerID="e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"
May 20 20:24:31.048790 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.048771    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"} err="failed to get container status \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": rpc error: code = NotFound desc = could not find container \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": container with ID starting with e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37 not found: ID does not exist"
May 20 20:24:31.048852 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.048791    2575 scope.go:117] "RemoveContainer" containerID="a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"
May 20 20:24:31.049037 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049013    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"} err="failed to get container status \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": rpc error: code = NotFound desc = could not find container \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": container with ID starting with a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238 not found: ID does not exist"
May 20 20:24:31.049131 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049038    2575 scope.go:117] "RemoveContainer" containerID="17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"
May 20 20:24:31.049322 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049299    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"} err="failed to get container status \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": rpc error: code = NotFound desc = could not find container \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": container with ID starting with 17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa not found: ID does not exist"
May 20 20:24:31.049437 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049322    2575 scope.go:117] "RemoveContainer" containerID="b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"
May 20 20:24:31.049506 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049489    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:24:31.049598 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049579    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"} err="failed to get container status \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": rpc error: code = NotFound desc = could not find container \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": container with ID starting with b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea not found: ID does not exist"
May 20 20:24:31.049660 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049599    2575 scope.go:117] "RemoveContainer" containerID="77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"
May 20 20:24:31.049808 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049790    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"} err="failed to get container status \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": rpc error: code = NotFound desc = could not find container \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": container with ID starting with 77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5 not found: ID does not exist"
May 20 20:24:31.049863 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049808    2575 scope.go:117] "RemoveContainer" containerID="92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"
May 20 20:24:31.049913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049890    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="prometheus"
May 20 20:24:31.049913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049906    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="prometheus"
May 20 20:24:31.050010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049920    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy-web"
May 20 20:24:31.050010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049930    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy-web"
May 20 20:24:31.050010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049944    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="config-reloader"
May 20 20:24:31.050010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049952    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="config-reloader"
May 20 20:24:31.050010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049963    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy-thanos"
May 20 20:24:31.050010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049971    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy-thanos"
May 20 20:24:31.050010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049985    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy"
May 20 20:24:31.050010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049993    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy"
May 20 20:24:31.050010 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.049999    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"} err="failed to get container status \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": rpc error: code = NotFound desc = could not find container \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": container with ID starting with 92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467 not found: ID does not exist"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050019    2575 scope.go:117] "RemoveContainer" containerID="415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050005    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="thanos-sidecar"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050057    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="thanos-sidecar"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050081    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="init-config-reloader"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050089    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="init-config-reloader"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050170    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="thanos-sidecar"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050182    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="prometheus"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050212    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy-web"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050224    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy-thanos"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050218    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"} err="failed to get container status \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": rpc error: code = NotFound desc = could not find container \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": container with ID starting with 415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b not found: ID does not exist"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050234    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="config-reloader"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050241    2575 scope.go:117] "RemoveContainer" containerID="e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"
May 20 20:24:31.050355 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050245    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" containerName="kube-rbac-proxy"
May 20 20:24:31.050888 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050470    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"} err="failed to get container status \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": rpc error: code = NotFound desc = could not find container \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": container with ID starting with e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37 not found: ID does not exist"
May 20 20:24:31.050888 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050486    2575 scope.go:117] "RemoveContainer" containerID="a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"
May 20 20:24:31.050888 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050701    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"} err="failed to get container status \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": rpc error: code = NotFound desc = could not find container \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": container with ID starting with a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238 not found: ID does not exist"
May 20 20:24:31.050888 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050724    2575 scope.go:117] "RemoveContainer" containerID="17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"
May 20 20:24:31.051026 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050968    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"} err="failed to get container status \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": rpc error: code = NotFound desc = could not find container \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": container with ID starting with 17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa not found: ID does not exist"
May 20 20:24:31.051026 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.050983    2575 scope.go:117] "RemoveContainer" containerID="b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"
May 20 20:24:31.051228 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.051210    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"} err="failed to get container status \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": rpc error: code = NotFound desc = could not find container \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": container with ID starting with b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea not found: ID does not exist"
May 20 20:24:31.051274 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.051229    2575 scope.go:117] "RemoveContainer" containerID="77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"
May 20 20:24:31.051434 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.051418    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"} err="failed to get container status \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": rpc error: code = NotFound desc = could not find container \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": container with ID starting with 77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5 not found: ID does not exist"
May 20 20:24:31.051481 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.051435    2575 scope.go:117] "RemoveContainer" containerID="92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"
May 20 20:24:31.051661 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.051641    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"} err="failed to get container status \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": rpc error: code = NotFound desc = could not find container \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": container with ID starting with 92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467 not found: ID does not exist"
May 20 20:24:31.051718 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.051664    2575 scope.go:117] "RemoveContainer" containerID="415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"
May 20 20:24:31.051870 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.051851    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"} err="failed to get container status \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": rpc error: code = NotFound desc = could not find container \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": container with ID starting with 415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b not found: ID does not exist"
May 20 20:24:31.051870 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.051870    2575 scope.go:117] "RemoveContainer" containerID="e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"
May 20 20:24:31.052076 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.052059    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"} err="failed to get container status \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": rpc error: code = NotFound desc = could not find container \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": container with ID starting with e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37 not found: ID does not exist"
May 20 20:24:31.052125 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.052077    2575 scope.go:117] "RemoveContainer" containerID="a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"
May 20 20:24:31.052302 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.052281    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"} err="failed to get container status \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": rpc error: code = NotFound desc = could not find container \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": container with ID starting with a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238 not found: ID does not exist"
May 20 20:24:31.052354 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.052304    2575 scope.go:117] "RemoveContainer" containerID="17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"
May 20 20:24:31.052493 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.052475    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"} err="failed to get container status \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": rpc error: code = NotFound desc = could not find container \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": container with ID starting with 17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa not found: ID does not exist"
May 20 20:24:31.052558 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.052496    2575 scope.go:117] "RemoveContainer" containerID="b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"
May 20 20:24:31.052728 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.052711    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"} err="failed to get container status \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": rpc error: code = NotFound desc = could not find container \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": container with ID starting with b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea not found: ID does not exist"
May 20 20:24:31.052770 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.052729    2575 scope.go:117] "RemoveContainer" containerID="77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"
May 20 20:24:31.052926 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.052910    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"} err="failed to get container status \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": rpc error: code = NotFound desc = could not find container \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": container with ID starting with 77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5 not found: ID does not exist"
May 20 20:24:31.052976 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.052927    2575 scope.go:117] "RemoveContainer" containerID="92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"
May 20 20:24:31.053125 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.053109    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"} err="failed to get container status \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": rpc error: code = NotFound desc = could not find container \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": container with ID starting with 92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467 not found: ID does not exist"
May 20 20:24:31.053211 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.053127    2575 scope.go:117] "RemoveContainer" containerID="415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"
May 20 20:24:31.053407 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.053388    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"} err="failed to get container status \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": rpc error: code = NotFound desc = could not find container \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": container with ID starting with 415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b not found: ID does not exist"
May 20 20:24:31.053443 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.053410    2575 scope.go:117] "RemoveContainer" containerID="e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"
May 20 20:24:31.053602 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.053587    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"} err="failed to get container status \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": rpc error: code = NotFound desc = could not find container \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": container with ID starting with e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37 not found: ID does not exist"
May 20 20:24:31.053646 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.053602    2575 scope.go:117] "RemoveContainer" containerID="a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"
May 20 20:24:31.053763 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.053748    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"} err="failed to get container status \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": rpc error: code = NotFound desc = could not find container \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": container with ID starting with a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238 not found: ID does not exist"
May 20 20:24:31.053802 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.053763    2575 scope.go:117] "RemoveContainer" containerID="17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"
May 20 20:24:31.053970 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.053956    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"} err="failed to get container status \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": rpc error: code = NotFound desc = could not find container \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": container with ID starting with 17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa not found: ID does not exist"
May 20 20:24:31.054022 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.053970    2575 scope.go:117] "RemoveContainer" containerID="b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"
May 20 20:24:31.054163 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.054144    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea"} err="failed to get container status \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": rpc error: code = NotFound desc = could not find container \"b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea\": container with ID starting with b3901da2bb33fd32e38a1588fd8e4418515cc29cad54f957c0e9e4a5e9bee5ea not found: ID does not exist"
May 20 20:24:31.054229 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.054163    2575 scope.go:117] "RemoveContainer" containerID="77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"
May 20 20:24:31.054372 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.054355    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5"} err="failed to get container status \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": rpc error: code = NotFound desc = could not find container \"77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5\": container with ID starting with 77a4ed771d299b1d35296c1a4cfe31fe31236e4ea3431b7eefae6c8ad98a02a5 not found: ID does not exist"
May 20 20:24:31.054439 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.054375    2575 scope.go:117] "RemoveContainer" containerID="92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"
May 20 20:24:31.054562 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.054549    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467"} err="failed to get container status \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": rpc error: code = NotFound desc = could not find container \"92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467\": container with ID starting with 92478f101bc22113f5d9c74cb7716adf3d733f9fd94def430651ffb3e2fc9467 not found: ID does not exist"
May 20 20:24:31.054608 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.054563    2575 scope.go:117] "RemoveContainer" containerID="415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"
May 20 20:24:31.054720 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.054706    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b"} err="failed to get container status \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": rpc error: code = NotFound desc = could not find container \"415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b\": container with ID starting with 415375cacde1a6776fdb1c7411264cb5726aab2c07d11647c92ea6824725c41b not found: ID does not exist"
May 20 20:24:31.054765 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.054719    2575 scope.go:117] "RemoveContainer" containerID="e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"
May 20 20:24:31.054890 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.054864    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37"} err="failed to get container status \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": rpc error: code = NotFound desc = could not find container \"e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37\": container with ID starting with e523a360aa4582e59f0a9a40abe2f1635dc4b5d95087984404ab4dfacb80ce37 not found: ID does not exist"
May 20 20:24:31.054890 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.054881    2575 scope.go:117] "RemoveContainer" containerID="a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"
May 20 20:24:31.055072 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.055058    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238"} err="failed to get container status \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": rpc error: code = NotFound desc = could not find container \"a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238\": container with ID starting with a0e62a40ee3a90ef7d3badf39f3c0a546b9fccde1afbd7bc10cde92667b1b238 not found: ID does not exist"
May 20 20:24:31.055072 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.055071    2575 scope.go:117] "RemoveContainer" containerID="17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"
May 20 20:24:31.055277 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.055260    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa"} err="failed to get container status \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": rpc error: code = NotFound desc = could not find container \"17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa\": container with ID starting with 17d90217b44da2538c5658d89ce0c41132079ab83589dce3132e4e0cac81c6aa not found: ID does not exist"
May 20 20:24:31.056823 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.056809    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.059331 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.059309    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 20 20:24:31.059331 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.059309    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 20 20:24:31.059521 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.059383    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 20 20:24:31.059521 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.059310    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 20 20:24:31.059521 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.059437    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h42hc\""
May 20 20:24:31.059521 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.059449    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 20 20:24:31.059815 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.059800    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 20 20:24:31.059892 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.059876    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 20 20:24:31.059949 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.059910    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 20 20:24:31.059949 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.059876    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-35solf4u9651p\""
May 20 20:24:31.060057 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.059966    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 20 20:24:31.060112 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.060100    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 20 20:24:31.062659 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.062641    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 20 20:24:31.064658 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.064640    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 20 20:24:31.074158 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.074134    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:24:31.149953 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.149915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-config\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.149953 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.149950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a71786b-f612-46a3-95b1-81071a028aef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150232 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.149988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150232 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150232 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150232 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150232 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150117    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150232 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150181    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150232 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150230    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xvw2\" (UniqueName: \"kubernetes.io/projected/1a71786b-f612-46a3-95b1-81071a028aef-kube-api-access-7xvw2\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150576 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150262    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a71786b-f612-46a3-95b1-81071a028aef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150576 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150290    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150576 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150576 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150350    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150576 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150388    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150576 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150576 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150576 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.150576 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.150529    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a71786b-f612-46a3-95b1-81071a028aef-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.250971 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.250874    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.250971 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.250940    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.250971 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.250959    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251262 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251098    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a71786b-f612-46a3-95b1-81071a028aef-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251262 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251143    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-config\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251262 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251175    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a71786b-f612-46a3-95b1-81071a028aef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251412 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251325    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251412 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251359    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251412 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251386    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251550 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251410    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251550 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251438    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251550 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251514    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251550 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251540    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xvw2\" (UniqueName: \"kubernetes.io/projected/1a71786b-f612-46a3-95b1-81071a028aef-kube-api-access-7xvw2\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251734 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251561    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a71786b-f612-46a3-95b1-81071a028aef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251734 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251576    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a71786b-f612-46a3-95b1-81071a028aef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251734 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251620    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251734 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251664    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251734 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251689    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251734 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251699    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.251734 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251722    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.252068 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.251878    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.252438 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.252414    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.253819 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.253786    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a71786b-f612-46a3-95b1-81071a028aef-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.254702 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.254110    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.254702 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.254269    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a71786b-f612-46a3-95b1-81071a028aef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.254702 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.254352    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.254702 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.254568    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-config\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.254702 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.254652    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.254990 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.254804    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.254990 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.254969    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.255572 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.255552    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.256430 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.256413    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.256624 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.256604    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.256808 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.256793    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a71786b-f612-46a3-95b1-81071a028aef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.257573 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.257554    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a71786b-f612-46a3-95b1-81071a028aef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.261521 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.261500    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xvw2\" (UniqueName: \"kubernetes.io/projected/1a71786b-f612-46a3-95b1-81071a028aef-kube-api-access-7xvw2\") pod \"prometheus-k8s-0\" (UID: \"1a71786b-f612-46a3-95b1-81071a028aef\") " pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.366494 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.366457    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:31.501119 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.500799    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 20 20:24:31.503528 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:24:31.503504    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a71786b_f612_46a3_95b1_81071a028aef.slice/crio-d1c85a512ee35e1e26e4ec2480ca478028ab6a6975b7d9acc3139ed00e529f2c WatchSource:0}: Error finding container d1c85a512ee35e1e26e4ec2480ca478028ab6a6975b7d9acc3139ed00e529f2c: Status 404 returned error can't find the container with id d1c85a512ee35e1e26e4ec2480ca478028ab6a6975b7d9acc3139ed00e529f2c
May 20 20:24:31.788856 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.788782    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:24:31.788856 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.788831    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:24:31.789047 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.788871    2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:24:31.789365 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.789336    2575 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"492e03ff93f18593d509384788beda4b8ee6a719db2434085938de1245718f80"} pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" containerMessage="Container registry failed liveness probe, will be restarted"
May 20 20:24:31.792626 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.792596    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:24:31.792737 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:31.792637    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:24:32.003941 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:32.003908    2575 generic.go:358] "Generic (PLEG): container finished" podID="1a71786b-f612-46a3-95b1-81071a028aef" containerID="0b0edd7a293e73e567723d5292a2011a2aae7f79df721f3e9886a19d9c092da4" exitCode=0
May 20 20:24:32.004437 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:32.003995    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a71786b-f612-46a3-95b1-81071a028aef","Type":"ContainerDied","Data":"0b0edd7a293e73e567723d5292a2011a2aae7f79df721f3e9886a19d9c092da4"}
May 20 20:24:32.004437 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:32.004023    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a71786b-f612-46a3-95b1-81071a028aef","Type":"ContainerStarted","Data":"d1c85a512ee35e1e26e4ec2480ca478028ab6a6975b7d9acc3139ed00e529f2c"}
May 20 20:24:32.143393 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:32.143363    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a82006fe-f4f4-4a27-9be8-f1c656b8646d" path="/var/lib/kubelet/pods/a82006fe-f4f4-4a27-9be8-f1c656b8646d/volumes"
May 20 20:24:33.012615 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:33.012578    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a71786b-f612-46a3-95b1-81071a028aef","Type":"ContainerStarted","Data":"f848e9b5863b0a8e2b37bdd3d982649bb9bbc16808b8116238afe77a742c06cd"}
May 20 20:24:33.012615 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:33.012616    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a71786b-f612-46a3-95b1-81071a028aef","Type":"ContainerStarted","Data":"688e08ac3a3f7d0cbbdcfd14c9664b8f87523161011e49931e773b1a1a179096"}
May 20 20:24:33.013043 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:33.012628    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a71786b-f612-46a3-95b1-81071a028aef","Type":"ContainerStarted","Data":"41161a96c51e823f7b1d2defde8e414afc48e35857bfbb9cbc28b83cf0f4be5f"}
May 20 20:24:33.013043 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:33.012639    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a71786b-f612-46a3-95b1-81071a028aef","Type":"ContainerStarted","Data":"af59d3d080a07915e6893ca4c9b151879e5f19429efa47477b4185cf220f8fe1"}
May 20 20:24:33.013043 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:33.012650    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a71786b-f612-46a3-95b1-81071a028aef","Type":"ContainerStarted","Data":"39d7a124d0a6f6b7c4bd821454577503dae023adfef300923567bc4735439fa6"}
May 20 20:24:33.013043 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:33.012663    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a71786b-f612-46a3-95b1-81071a028aef","Type":"ContainerStarted","Data":"06a1450cf83d3ce0ccc002720eb479c2d26cbe55951d17bae41906909a4e0d29"}
May 20 20:24:33.043119 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:33.042974    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.042957419 podStartE2EDuration="2.042957419s" podCreationTimestamp="2026-05-20 20:24:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:24:33.041135861 +0000 UTC m=+279.487718080" watchObservedRunningTime="2026-05-20 20:24:33.042957419 +0000 UTC m=+279.489539635"
May 20 20:24:33.606968 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:24:33.606927    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8w2r7" podUID="c12b8325-2b1d-4837-9d3d-7df8fb7b4f58"
May 20 20:24:34.015638 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:34.015604    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8w2r7"
May 20 20:24:36.366881 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:36.366842    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:24:36.904235 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:36.904153    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:24:36.906408 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:36.906380    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c12b8325-2b1d-4837-9d3d-7df8fb7b4f58-metrics-tls\") pod \"dns-default-8w2r7\" (UID: \"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58\") " pod="openshift-dns/dns-default-8w2r7"
May 20 20:24:37.004648 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:37.004611    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:24:37.006981 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:37.006956    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15c1ec37-1eb0-4805-9fb4-f651bb85f3d0-cert\") pod \"ingress-canary-288pq\" (UID: \"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0\") " pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:24:37.019367 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:37.019336    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8wmjb\""
May 20 20:24:37.027987 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:37.027964    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8w2r7"
May 20 20:24:37.153984 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:37.153956    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8w2r7"]
May 20 20:24:37.155572 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:24:37.155493    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12b8325_2b1d_4837_9d3d_7df8fb7b4f58.slice/crio-d900daf720ac6d36d83f748666c3c429e572df6708cd71fd21d62477405e477f WatchSource:0}: Error finding container d900daf720ac6d36d83f748666c3c429e572df6708cd71fd21d62477405e477f: Status 404 returned error can't find the container with id d900daf720ac6d36d83f748666c3c429e572df6708cd71fd21d62477405e477f
May 20 20:24:37.241598 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:37.241568    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6s6vr\""
May 20 20:24:37.249619 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:37.249600    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-288pq"
May 20 20:24:37.386031 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:37.386006    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-288pq"]
May 20 20:24:37.388403 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:24:37.388376    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c1ec37_1eb0_4805_9fb4_f651bb85f3d0.slice/crio-92ee4b433914689fb84c316470038b55e684f4e0035993eb19057672dd714306 WatchSource:0}: Error finding container 92ee4b433914689fb84c316470038b55e684f4e0035993eb19057672dd714306: Status 404 returned error can't find the container with id 92ee4b433914689fb84c316470038b55e684f4e0035993eb19057672dd714306
May 20 20:24:38.031263 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:38.031225    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8w2r7" event={"ID":"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58","Type":"ContainerStarted","Data":"d900daf720ac6d36d83f748666c3c429e572df6708cd71fd21d62477405e477f"}
May 20 20:24:38.032528 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:38.032496    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-288pq" event={"ID":"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0","Type":"ContainerStarted","Data":"92ee4b433914689fb84c316470038b55e684f4e0035993eb19057672dd714306"}
May 20 20:24:39.038258 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:39.038214    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8w2r7" event={"ID":"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58","Type":"ContainerStarted","Data":"c048fec8d7c99d144395320199c8153ae7a21d2930154152f84995b60bfb2bbe"}
May 20 20:24:39.038258 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:39.038260    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8w2r7" event={"ID":"c12b8325-2b1d-4837-9d3d-7df8fb7b4f58","Type":"ContainerStarted","Data":"ea09d68a069b5401a35ccba3b5138d6da368bd5413b97de37ecc85885c278f26"}
May 20 20:24:39.038728 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:39.038359    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8w2r7"
May 20 20:24:39.057909 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:39.057854    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-8w2r7" podStartSLOduration=251.76673081 podStartE2EDuration="4m13.057836352s" podCreationTimestamp="2026-05-20 20:20:26 +0000 UTC" firstStartedPulling="2026-05-20 20:24:37.157509855 +0000 UTC m=+283.604092053" lastFinishedPulling="2026-05-20 20:24:38.448615395 +0000 UTC m=+284.895197595" observedRunningTime="2026-05-20 20:24:39.057128675 +0000 UTC m=+285.503710891" watchObservedRunningTime="2026-05-20 20:24:39.057836352 +0000 UTC m=+285.504418571"
May 20 20:24:40.042894 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:40.042852    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-288pq" event={"ID":"15c1ec37-1eb0-4805-9fb4-f651bb85f3d0","Type":"ContainerStarted","Data":"b7fb1bb8676c33979346324677a4789cb637033b52ffd9933c2801b95c6aacb2"}
May 20 20:24:40.059938 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:40.059875    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-288pq" podStartSLOduration=252.233627239 podStartE2EDuration="4m14.059860606s" podCreationTimestamp="2026-05-20 20:20:26 +0000 UTC" firstStartedPulling="2026-05-20 20:24:37.390165274 +0000 UTC m=+283.836747468" lastFinishedPulling="2026-05-20 20:24:39.216398636 +0000 UTC m=+285.662980835" observedRunningTime="2026-05-20 20:24:40.058030412 +0000 UTC m=+286.504612638" watchObservedRunningTime="2026-05-20 20:24:40.059860606 +0000 UTC m=+286.506442821"
May 20 20:24:41.792853 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:41.792821    2575 patch_prober.go:28] interesting pod/image-registry-6d75bc698b-vhtbp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 20:24:41.793314 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:41.792885    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:24:49.045900 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:49.045867    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8w2r7"
May 20 20:24:51.793604 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:51.793576    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:24:54.065088 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:54.065061    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:24:54.065597 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:54.065105    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:24:54.072298 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:54.072277    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:24:54.072419 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:54.072317    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:24:54.075817 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:54.075802    2575 kubelet.go:1628] "Image garbage collection succeeded"
May 20 20:24:56.807101 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:56.807055    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" podUID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerName="registry" containerID="cri-o://492e03ff93f18593d509384788beda4b8ee6a719db2434085938de1245718f80" gracePeriod=30
May 20 20:24:57.918114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:57.918094    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:24:58.098605 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:58.098568    2575 generic.go:358] "Generic (PLEG): container finished" podID="84386a5b-6b8a-45da-aa84-f6a252a57727" containerID="492e03ff93f18593d509384788beda4b8ee6a719db2434085938de1245718f80" exitCode=0
May 20 20:24:58.098803 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:58.098628    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" event={"ID":"84386a5b-6b8a-45da-aa84-f6a252a57727","Type":"ContainerDied","Data":"492e03ff93f18593d509384788beda4b8ee6a719db2434085938de1245718f80"}
May 20 20:24:58.098803 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:58.098652    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp" event={"ID":"84386a5b-6b8a-45da-aa84-f6a252a57727","Type":"ContainerStarted","Data":"ae94c14df5f48b752277f0554ed8ba33ac5639e8674b0d54d7718c32c0dfa66c"}
May 20 20:24:58.098803 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:58.098665    2575 scope.go:117] "RemoveContainer" containerID="ee3d9ae97d7a8dbf6464c3931fb827133427918a1a3eb4613d6870c32338cf63"
May 20 20:24:58.098803 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:24:58.098737    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:25:19.107379 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:25:19.107347    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d75bc698b-vhtbp"
May 20 20:25:31.367160 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:25:31.367068    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:25:31.382416 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:25:31.382382    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:25:32.212745 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:25:32.212719    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 20 20:27:38.816014 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.815930    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"]
May 20 20:27:38.818520 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.818499    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:38.822096 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.822063    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 20 20:27:38.822261 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.822137    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9cb65\""
May 20 20:27:38.822341 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.822324    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 20 20:27:38.822406 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.822342    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 20 20:27:38.822406 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.822379    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 20 20:27:38.822697 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.822683    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 20 20:27:38.828377 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.828355    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"]
May 20 20:27:38.980347 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.980305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-manager-config\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:38.980533 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.980413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-cert\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:38.980533 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.980475    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcpss\" (UniqueName: \"kubernetes.io/projected/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-kube-api-access-bcpss\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:38.980533 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:38.980499    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-metrics-cert\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:39.081755 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.081670    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcpss\" (UniqueName: \"kubernetes.io/projected/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-kube-api-access-bcpss\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:39.081755 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.081707    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-metrics-cert\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:39.081961 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.081756    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-manager-config\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:39.081961 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.081816    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-cert\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:39.082432 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.082408    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-manager-config\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:39.084153 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.084121    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-metrics-cert\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:39.084295 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.084276    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-cert\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:39.092916 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.092895    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcpss\" (UniqueName: \"kubernetes.io/projected/b3661c98-1aec-4ee1-bb57-f34d832fdcf1-kube-api-access-bcpss\") pod \"lws-controller-manager-84d5db74c-knvs4\" (UID: \"b3661c98-1aec-4ee1-bb57-f34d832fdcf1\") " pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:39.127843 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.127809    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:39.261913 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.261887    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"]
May 20 20:27:39.264443 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:27:39.264416    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3661c98_1aec_4ee1_bb57_f34d832fdcf1.slice/crio-c0c40a72f12b4aa8c30197b0aa4f20beded3d0bce5cf013359ebeaf132c2487e WatchSource:0}: Error finding container c0c40a72f12b4aa8c30197b0aa4f20beded3d0bce5cf013359ebeaf132c2487e: Status 404 returned error can't find the container with id c0c40a72f12b4aa8c30197b0aa4f20beded3d0bce5cf013359ebeaf132c2487e
May 20 20:27:39.488562 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.488529    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"]
May 20 20:27:39.491542 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.491521    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:39.493961 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.493941    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 20 20:27:39.494351 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.494332    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 20 20:27:39.494498 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.494358    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 20 20:27:39.494634 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.494619    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 20 20:27:39.494703 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.494665    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7njkd\""
May 20 20:27:39.505886 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.505838    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"]
May 20 20:27:39.574772 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.574733    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4" event={"ID":"b3661c98-1aec-4ee1-bb57-f34d832fdcf1","Type":"ContainerStarted","Data":"c0c40a72f12b4aa8c30197b0aa4f20beded3d0bce5cf013359ebeaf132c2487e"}
May 20 20:27:39.587374 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.587339    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/77329b3f-fe92-48fe-9b4d-21f817f1eda0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-5mjz7\" (UID: \"77329b3f-fe92-48fe-9b4d-21f817f1eda0\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:39.587569 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.587396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wrgr\" (UniqueName: \"kubernetes.io/projected/77329b3f-fe92-48fe-9b4d-21f817f1eda0-kube-api-access-6wrgr\") pod \"opendatahub-operator-controller-manager-76c978b984-5mjz7\" (UID: \"77329b3f-fe92-48fe-9b4d-21f817f1eda0\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:39.587569 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.587434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77329b3f-fe92-48fe-9b4d-21f817f1eda0-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-5mjz7\" (UID: \"77329b3f-fe92-48fe-9b4d-21f817f1eda0\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:39.688875 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.688832    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/77329b3f-fe92-48fe-9b4d-21f817f1eda0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-5mjz7\" (UID: \"77329b3f-fe92-48fe-9b4d-21f817f1eda0\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:39.689029 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.688946    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wrgr\" (UniqueName: \"kubernetes.io/projected/77329b3f-fe92-48fe-9b4d-21f817f1eda0-kube-api-access-6wrgr\") pod \"opendatahub-operator-controller-manager-76c978b984-5mjz7\" (UID: \"77329b3f-fe92-48fe-9b4d-21f817f1eda0\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:39.689029 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.688968    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77329b3f-fe92-48fe-9b4d-21f817f1eda0-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-5mjz7\" (UID: \"77329b3f-fe92-48fe-9b4d-21f817f1eda0\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:39.691236 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.691214    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/77329b3f-fe92-48fe-9b4d-21f817f1eda0-webhook-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-5mjz7\" (UID: \"77329b3f-fe92-48fe-9b4d-21f817f1eda0\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:39.691334 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.691244    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/77329b3f-fe92-48fe-9b4d-21f817f1eda0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76c978b984-5mjz7\" (UID: \"77329b3f-fe92-48fe-9b4d-21f817f1eda0\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:39.702867 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.702841    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wrgr\" (UniqueName: \"kubernetes.io/projected/77329b3f-fe92-48fe-9b4d-21f817f1eda0-kube-api-access-6wrgr\") pod \"opendatahub-operator-controller-manager-76c978b984-5mjz7\" (UID: \"77329b3f-fe92-48fe-9b4d-21f817f1eda0\") " pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:39.802215 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.802110    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:39.941590 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:39.941553    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"]
May 20 20:27:39.944777 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:27:39.944750    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77329b3f_fe92_48fe_9b4d_21f817f1eda0.slice/crio-95f8abb4ced93512447f420c6c58fee272dda35fb4f7ad43712592ec43c70678 WatchSource:0}: Error finding container 95f8abb4ced93512447f420c6c58fee272dda35fb4f7ad43712592ec43c70678: Status 404 returned error can't find the container with id 95f8abb4ced93512447f420c6c58fee272dda35fb4f7ad43712592ec43c70678
May 20 20:27:40.582978 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:40.582917    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7" event={"ID":"77329b3f-fe92-48fe-9b4d-21f817f1eda0","Type":"ContainerStarted","Data":"95f8abb4ced93512447f420c6c58fee272dda35fb4f7ad43712592ec43c70678"}
May 20 20:27:43.598027 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:43.598006    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:43.615351 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:43.615294    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4" podStartSLOduration=1.3523570679999999 podStartE2EDuration="5.61527588s" podCreationTimestamp="2026-05-20 20:27:38 +0000 UTC" firstStartedPulling="2026-05-20 20:27:39.266594486 +0000 UTC m=+465.713176685" lastFinishedPulling="2026-05-20 20:27:43.529513297 +0000 UTC m=+469.976095497" observedRunningTime="2026-05-20 20:27:43.613866866 +0000 UTC m=+470.060449081" watchObservedRunningTime="2026-05-20 20:27:43.61527588 +0000 UTC m=+470.061858097"
May 20 20:27:44.602322 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:44.602280    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4" event={"ID":"b3661c98-1aec-4ee1-bb57-f34d832fdcf1","Type":"ContainerStarted","Data":"22f991463e91dc1f18079cc333eeb5e4890e1d7074327bdc0f8c4833716f09a5"}
May 20 20:27:44.603527 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:44.603498    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7" event={"ID":"77329b3f-fe92-48fe-9b4d-21f817f1eda0","Type":"ContainerStarted","Data":"c1c2ad90861117f0c2b49363f18b41f347cf54bc0fcc65b8e3cbb78d14ef9700"}
May 20 20:27:44.603665 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:44.603647    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:27:44.625297 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:44.625253    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7" podStartSLOduration=2.069282205 podStartE2EDuration="5.625239581s" podCreationTimestamp="2026-05-20 20:27:39 +0000 UTC" firstStartedPulling="2026-05-20 20:27:39.946410951 +0000 UTC m=+466.392993145" lastFinishedPulling="2026-05-20 20:27:43.502368311 +0000 UTC m=+469.948950521" observedRunningTime="2026-05-20 20:27:44.623391938 +0000 UTC m=+471.069974154" watchObservedRunningTime="2026-05-20 20:27:44.625239581 +0000 UTC m=+471.071821798"
May 20 20:27:55.608270 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:55.608241    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84d5db74c-knvs4"
May 20 20:27:55.608643 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:27:55.608292    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76c978b984-5mjz7"
May 20 20:28:23.759605 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.759573    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"]
May 20 20:28:23.762138 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.762112    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.764589 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.764563    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 20 20:28:23.764704 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.764594    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 20 20:28:23.764838 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.764821    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 20 20:28:23.765175 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.765158    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s8grn\""
May 20 20:28:23.772063 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.772044    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"]
May 20 20:28:23.881656 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.881620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.881846 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.881722    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.881846 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.881753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.881846 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.881781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.881846 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.881816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.882103 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.881845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.882103 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.881930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.882103 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.881960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.882103 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.881996    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gfq7\" (UniqueName: \"kubernetes.io/projected/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-kube-api-access-6gfq7\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.983388 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.983354    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gfq7\" (UniqueName: \"kubernetes.io/projected/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-kube-api-access-6gfq7\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.983566 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.983397    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.983566 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.983431    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.983566 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.983450    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.983566 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.983468    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.983566 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.983490    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.983566 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.983519    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.983854 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.983684    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.983854 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.983731    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.983973 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.983954    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.984034 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.983991    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.984096 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.984045    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.984237 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.984219    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.984494 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.984476    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.985916 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.985899    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.986036 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.986020    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.995257 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.995229    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gfq7\" (UniqueName: \"kubernetes.io/projected/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-kube-api-access-6gfq7\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:23.997644 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:23.997622    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8af515e-9ab9-47e6-aa8e-a8bad81a96bc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x\" (UID: \"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:24.073052 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:24.072965    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:24.208704 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:24.208648    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"]
May 20 20:28:24.211633 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:28:24.211601    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8af515e_9ab9_47e6_aa8e_a8bad81a96bc.slice/crio-4b90f545f08d6a6002ff54da9880bbfd638e0dc5327264e1e7ca27b837d7c464 WatchSource:0}: Error finding container 4b90f545f08d6a6002ff54da9880bbfd638e0dc5327264e1e7ca27b837d7c464: Status 404 returned error can't find the container with id 4b90f545f08d6a6002ff54da9880bbfd638e0dc5327264e1e7ca27b837d7c464
May 20 20:28:24.738041 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:24.738000    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x" event={"ID":"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc","Type":"ContainerStarted","Data":"4b90f545f08d6a6002ff54da9880bbfd638e0dc5327264e1e7ca27b837d7c464"}
May 20 20:28:26.589903 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:26.589859    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 20 20:28:26.590174 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:26.589936    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 20 20:28:26.590174 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:26.589966    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 20 20:28:26.745998 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:26.745962    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x" event={"ID":"e8af515e-9ab9-47e6-aa8e-a8bad81a96bc","Type":"ContainerStarted","Data":"5c1d59c0c983f2c14f73b9b2a464b7fa907a3fa5db41f004ae954379353d5616"}
May 20 20:28:26.778866 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:26.778801    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x" podStartSLOduration=1.402839156 podStartE2EDuration="3.778781751s" podCreationTimestamp="2026-05-20 20:28:23 +0000 UTC" firstStartedPulling="2026-05-20 20:28:24.213624882 +0000 UTC m=+510.660207077" lastFinishedPulling="2026-05-20 20:28:26.58956746 +0000 UTC m=+513.036149672" observedRunningTime="2026-05-20 20:28:26.776983817 +0000 UTC m=+513.223566034" watchObservedRunningTime="2026-05-20 20:28:26.778781751 +0000 UTC m=+513.225363969"
May 20 20:28:27.073837 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:27.073799    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:27.078403 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:27.078378    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:27.749520 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:27.749488    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:27.750531 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:27.750510    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x"
May 20 20:28:58.877004 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:58.876925    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7wlw8"]
May 20 20:28:58.879374 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:58.879358    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7wlw8"
May 20 20:28:58.881758 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:58.881739    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 20 20:28:58.881872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:58.881774    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 20 20:28:58.881872 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:58.881776    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-cblz4\""
May 20 20:28:58.892027 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:58.892004    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7wlw8"]
May 20 20:28:58.984219 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:58.984147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9twk\" (UniqueName: \"kubernetes.io/projected/f381465a-478d-49b4-ac54-4530256b75c5-kube-api-access-p9twk\") pod \"kuadrant-operator-catalog-7wlw8\" (UID: \"f381465a-478d-49b4-ac54-4530256b75c5\") " pod="kuadrant-system/kuadrant-operator-catalog-7wlw8"
May 20 20:28:59.085162 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.085126    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9twk\" (UniqueName: \"kubernetes.io/projected/f381465a-478d-49b4-ac54-4530256b75c5-kube-api-access-p9twk\") pod \"kuadrant-operator-catalog-7wlw8\" (UID: \"f381465a-478d-49b4-ac54-4530256b75c5\") " pod="kuadrant-system/kuadrant-operator-catalog-7wlw8"
May 20 20:28:59.094927 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.094901    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9twk\" (UniqueName: \"kubernetes.io/projected/f381465a-478d-49b4-ac54-4530256b75c5-kube-api-access-p9twk\") pod \"kuadrant-operator-catalog-7wlw8\" (UID: \"f381465a-478d-49b4-ac54-4530256b75c5\") " pod="kuadrant-system/kuadrant-operator-catalog-7wlw8"
May 20 20:28:59.188512 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.188427    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7wlw8"
May 20 20:28:59.223239 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.223203    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7wlw8"]
May 20 20:28:59.315349 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.315296    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7wlw8"]
May 20 20:28:59.317844 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:28:59.317817    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf381465a_478d_49b4_ac54_4530256b75c5.slice/crio-a1273936b78b27f11cbc227ba30d55504694d72d2f70524f3375444e11890e45 WatchSource:0}: Error finding container a1273936b78b27f11cbc227ba30d55504694d72d2f70524f3375444e11890e45: Status 404 returned error can't find the container with id a1273936b78b27f11cbc227ba30d55504694d72d2f70524f3375444e11890e45
May 20 20:28:59.444520 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.444443    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nqmnn"]
May 20 20:28:59.447715 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.447698    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nqmnn"
May 20 20:28:59.463235 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.463207    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nqmnn"]
May 20 20:28:59.490213 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.490163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dcwb\" (UniqueName: \"kubernetes.io/projected/77f97689-2c7e-4fc2-b6a3-373c73d25468-kube-api-access-6dcwb\") pod \"kuadrant-operator-catalog-nqmnn\" (UID: \"77f97689-2c7e-4fc2-b6a3-373c73d25468\") " pod="kuadrant-system/kuadrant-operator-catalog-nqmnn"
May 20 20:28:59.591468 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.591429    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6dcwb\" (UniqueName: \"kubernetes.io/projected/77f97689-2c7e-4fc2-b6a3-373c73d25468-kube-api-access-6dcwb\") pod \"kuadrant-operator-catalog-nqmnn\" (UID: \"77f97689-2c7e-4fc2-b6a3-373c73d25468\") " pod="kuadrant-system/kuadrant-operator-catalog-nqmnn"
May 20 20:28:59.599897 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.599867    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dcwb\" (UniqueName: \"kubernetes.io/projected/77f97689-2c7e-4fc2-b6a3-373c73d25468-kube-api-access-6dcwb\") pod \"kuadrant-operator-catalog-nqmnn\" (UID: \"77f97689-2c7e-4fc2-b6a3-373c73d25468\") " pod="kuadrant-system/kuadrant-operator-catalog-nqmnn"
May 20 20:28:59.757507 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.757393    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nqmnn"
May 20 20:28:59.861704 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.861672    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7wlw8" event={"ID":"f381465a-478d-49b4-ac54-4530256b75c5","Type":"ContainerStarted","Data":"a1273936b78b27f11cbc227ba30d55504694d72d2f70524f3375444e11890e45"}
May 20 20:28:59.896543 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:28:59.896516    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nqmnn"]
May 20 20:28:59.898981 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:28:59.898956    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f97689_2c7e_4fc2_b6a3_373c73d25468.slice/crio-1f7a71c9083ad20a7a2f097e95a48aba3a02fabb737d17e097d9ef7a031f385d WatchSource:0}: Error finding container 1f7a71c9083ad20a7a2f097e95a48aba3a02fabb737d17e097d9ef7a031f385d: Status 404 returned error can't find the container with id 1f7a71c9083ad20a7a2f097e95a48aba3a02fabb737d17e097d9ef7a031f385d
May 20 20:29:00.868874 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:00.868832    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nqmnn" event={"ID":"77f97689-2c7e-4fc2-b6a3-373c73d25468","Type":"ContainerStarted","Data":"1f7a71c9083ad20a7a2f097e95a48aba3a02fabb737d17e097d9ef7a031f385d"}
May 20 20:29:01.879021 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:01.878971    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7wlw8" event={"ID":"f381465a-478d-49b4-ac54-4530256b75c5","Type":"ContainerStarted","Data":"7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94"}
May 20 20:29:01.879540 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:01.879081    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7wlw8" podUID="f381465a-478d-49b4-ac54-4530256b75c5" containerName="registry-server" containerID="cri-o://7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94" gracePeriod=2
May 20 20:29:01.880533 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:01.880501    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nqmnn" event={"ID":"77f97689-2c7e-4fc2-b6a3-373c73d25468","Type":"ContainerStarted","Data":"82f9c98a81437e1a7a6af6e58719e992d9430f15a15a3f7a62f0beccdced0566"}
May 20 20:29:01.895548 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:01.895505    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7wlw8" podStartSLOduration=1.6391519749999999 podStartE2EDuration="3.895490861s" podCreationTimestamp="2026-05-20 20:28:58 +0000 UTC" firstStartedPulling="2026-05-20 20:28:59.31943911 +0000 UTC m=+545.766021305" lastFinishedPulling="2026-05-20 20:29:01.575777995 +0000 UTC m=+548.022360191" observedRunningTime="2026-05-20 20:29:01.894368086 +0000 UTC m=+548.340950301" watchObservedRunningTime="2026-05-20 20:29:01.895490861 +0000 UTC m=+548.342073089"
May 20 20:29:01.909678 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:01.909620    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nqmnn" podStartSLOduration=1.23107116 podStartE2EDuration="2.909603922s" podCreationTimestamp="2026-05-20 20:28:59 +0000 UTC" firstStartedPulling="2026-05-20 20:28:59.900502951 +0000 UTC m=+546.347085146" lastFinishedPulling="2026-05-20 20:29:01.579035699 +0000 UTC m=+548.025617908" observedRunningTime="2026-05-20 20:29:01.909071077 +0000 UTC m=+548.355653294" watchObservedRunningTime="2026-05-20 20:29:01.909603922 +0000 UTC m=+548.356186137"
May 20 20:29:02.111274 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.111185    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7wlw8"
May 20 20:29:02.216370 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.216288    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9twk\" (UniqueName: \"kubernetes.io/projected/f381465a-478d-49b4-ac54-4530256b75c5-kube-api-access-p9twk\") pod \"f381465a-478d-49b4-ac54-4530256b75c5\" (UID: \"f381465a-478d-49b4-ac54-4530256b75c5\") "
May 20 20:29:02.218239 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.218214    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f381465a-478d-49b4-ac54-4530256b75c5-kube-api-access-p9twk" (OuterVolumeSpecName: "kube-api-access-p9twk") pod "f381465a-478d-49b4-ac54-4530256b75c5" (UID: "f381465a-478d-49b4-ac54-4530256b75c5"). InnerVolumeSpecName "kube-api-access-p9twk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:29:02.317928 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.317893    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9twk\" (UniqueName: \"kubernetes.io/projected/f381465a-478d-49b4-ac54-4530256b75c5-kube-api-access-p9twk\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:29:02.884842 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.884809    2575 generic.go:358] "Generic (PLEG): container finished" podID="f381465a-478d-49b4-ac54-4530256b75c5" containerID="7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94" exitCode=0
May 20 20:29:02.885330 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.884874    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7wlw8"
May 20 20:29:02.885330 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.884888    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7wlw8" event={"ID":"f381465a-478d-49b4-ac54-4530256b75c5","Type":"ContainerDied","Data":"7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94"}
May 20 20:29:02.885330 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.884922    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7wlw8" event={"ID":"f381465a-478d-49b4-ac54-4530256b75c5","Type":"ContainerDied","Data":"a1273936b78b27f11cbc227ba30d55504694d72d2f70524f3375444e11890e45"}
May 20 20:29:02.885330 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.884937    2575 scope.go:117] "RemoveContainer" containerID="7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94"
May 20 20:29:02.893306 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.893281    2575 scope.go:117] "RemoveContainer" containerID="7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94"
May 20 20:29:02.893569 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:29:02.893550    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94\": container with ID starting with 7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94 not found: ID does not exist" containerID="7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94"
May 20 20:29:02.893637 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.893580    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94"} err="failed to get container status \"7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94\": rpc error: code = NotFound desc = could not find container \"7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94\": container with ID starting with 7265446c0e24216513c7a116f0f03353013ee1e4aaa58688b9ee0a9c086d9f94 not found: ID does not exist"
May 20 20:29:02.905756 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.905731    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7wlw8"]
May 20 20:29:02.911082 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:02.911058    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7wlw8"]
May 20 20:29:04.143847 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:04.143805    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f381465a-478d-49b4-ac54-4530256b75c5" path="/var/lib/kubelet/pods/f381465a-478d-49b4-ac54-4530256b75c5/volumes"
May 20 20:29:09.758560 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:09.758507    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nqmnn"
May 20 20:29:09.758560 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:09.758561    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nqmnn"
May 20 20:29:09.779665 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:09.779637    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nqmnn"
May 20 20:29:09.931950 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:09.931922    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nqmnn"
May 20 20:29:33.493266 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.493229    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-s9zh8"]
May 20 20:29:33.493737 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.493593    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f381465a-478d-49b4-ac54-4530256b75c5" containerName="registry-server"
May 20 20:29:33.493737 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.493603    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f381465a-478d-49b4-ac54-4530256b75c5" containerName="registry-server"
May 20 20:29:33.493737 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.493665    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="f381465a-478d-49b4-ac54-4530256b75c5" containerName="registry-server"
May 20 20:29:33.499391 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.499373    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-s9zh8"
May 20 20:29:33.504554 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.504530    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fpmz4\""
May 20 20:29:33.513041 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.513016    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-s9zh8"]
May 20 20:29:33.602504 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.602465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp6b7\" (UniqueName: \"kubernetes.io/projected/44cb6800-22ef-4aba-8ee7-0981045279fd-kube-api-access-wp6b7\") pod \"authorino-operator-657f44b778-s9zh8\" (UID: \"44cb6800-22ef-4aba-8ee7-0981045279fd\") " pod="kuadrant-system/authorino-operator-657f44b778-s9zh8"
May 20 20:29:33.703506 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.703467    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wp6b7\" (UniqueName: \"kubernetes.io/projected/44cb6800-22ef-4aba-8ee7-0981045279fd-kube-api-access-wp6b7\") pod \"authorino-operator-657f44b778-s9zh8\" (UID: \"44cb6800-22ef-4aba-8ee7-0981045279fd\") " pod="kuadrant-system/authorino-operator-657f44b778-s9zh8"
May 20 20:29:33.714337 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.714304    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp6b7\" (UniqueName: \"kubernetes.io/projected/44cb6800-22ef-4aba-8ee7-0981045279fd-kube-api-access-wp6b7\") pod \"authorino-operator-657f44b778-s9zh8\" (UID: \"44cb6800-22ef-4aba-8ee7-0981045279fd\") " pod="kuadrant-system/authorino-operator-657f44b778-s9zh8"
May 20 20:29:33.808724 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.808643    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-s9zh8"
May 20 20:29:33.944127 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.943934    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-s9zh8"]
May 20 20:29:33.946824 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:29:33.946800    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44cb6800_22ef_4aba_8ee7_0981045279fd.slice/crio-1661b527dc207e23a99168ef9445bf1c4f1a1f38cbc591391d8872f599a2cc8e WatchSource:0}: Error finding container 1661b527dc207e23a99168ef9445bf1c4f1a1f38cbc591391d8872f599a2cc8e: Status 404 returned error can't find the container with id 1661b527dc207e23a99168ef9445bf1c4f1a1f38cbc591391d8872f599a2cc8e
May 20 20:29:33.996555 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:33.996523    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-s9zh8" event={"ID":"44cb6800-22ef-4aba-8ee7-0981045279fd","Type":"ContainerStarted","Data":"1661b527dc207e23a99168ef9445bf1c4f1a1f38cbc591391d8872f599a2cc8e"}
May 20 20:29:36.300056 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:36.300029    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q"]
May 20 20:29:36.303399 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:36.303381    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q"
May 20 20:29:36.305512 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:36.305494    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 20 20:29:36.305596 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:36.305514    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-r4r55\""
May 20 20:29:36.312825 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:36.312801    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q"]
May 20 20:29:36.327593 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:36.327552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f68g8\" (UniqueName: \"kubernetes.io/projected/27de6293-f980-432c-b266-4cb542438b7c-kube-api-access-f68g8\") pod \"dns-operator-controller-manager-648d5c98bc-67x7q\" (UID: \"27de6293-f980-432c-b266-4cb542438b7c\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q"
May 20 20:29:36.428516 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:36.428485    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f68g8\" (UniqueName: \"kubernetes.io/projected/27de6293-f980-432c-b266-4cb542438b7c-kube-api-access-f68g8\") pod \"dns-operator-controller-manager-648d5c98bc-67x7q\" (UID: \"27de6293-f980-432c-b266-4cb542438b7c\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q"
May 20 20:29:36.436629 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:36.436608    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f68g8\" (UniqueName: \"kubernetes.io/projected/27de6293-f980-432c-b266-4cb542438b7c-kube-api-access-f68g8\") pod \"dns-operator-controller-manager-648d5c98bc-67x7q\" (UID: \"27de6293-f980-432c-b266-4cb542438b7c\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q"
May 20 20:29:36.614491 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:36.614412    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q"
May 20 20:29:36.753525 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:36.753500    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q"]
May 20 20:29:36.755421 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:29:36.755394    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27de6293_f980_432c_b266_4cb542438b7c.slice/crio-2bdf07e129eac48095de7c7b186590059abf03c99da81aaa53ad16edd0185045 WatchSource:0}: Error finding container 2bdf07e129eac48095de7c7b186590059abf03c99da81aaa53ad16edd0185045: Status 404 returned error can't find the container with id 2bdf07e129eac48095de7c7b186590059abf03c99da81aaa53ad16edd0185045
May 20 20:29:37.010081 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:37.010046    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-s9zh8" event={"ID":"44cb6800-22ef-4aba-8ee7-0981045279fd","Type":"ContainerStarted","Data":"927df0d31be5903766d8a5c36f2e011a8704ed78e44f39648587d20ed18e92a1"}
May 20 20:29:37.010286 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:37.010174    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-s9zh8"
May 20 20:29:37.011149 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:37.011125    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q" event={"ID":"27de6293-f980-432c-b266-4cb542438b7c","Type":"ContainerStarted","Data":"2bdf07e129eac48095de7c7b186590059abf03c99da81aaa53ad16edd0185045"}
May 20 20:29:37.036418 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:37.036368    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-s9zh8" podStartSLOduration=1.757417131 podStartE2EDuration="4.036354533s" podCreationTimestamp="2026-05-20 20:29:33 +0000 UTC" firstStartedPulling="2026-05-20 20:29:33.9486873 +0000 UTC m=+580.395269495" lastFinishedPulling="2026-05-20 20:29:36.227624699 +0000 UTC m=+582.674206897" observedRunningTime="2026-05-20 20:29:37.033501343 +0000 UTC m=+583.480083559" watchObservedRunningTime="2026-05-20 20:29:37.036354533 +0000 UTC m=+583.482936749"
May 20 20:29:40.023793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:40.023750    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q" event={"ID":"27de6293-f980-432c-b266-4cb542438b7c","Type":"ContainerStarted","Data":"07f3641330f688f3bc29a7be3e2fa3d71009f0afc8292bb5ad02d99e76b0bf81"}
May 20 20:29:40.024218 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:40.023890    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q"
May 20 20:29:40.046921 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:40.046869    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q" podStartSLOduration=1.5427857390000002 podStartE2EDuration="4.046853732s" podCreationTimestamp="2026-05-20 20:29:36 +0000 UTC" firstStartedPulling="2026-05-20 20:29:36.757851136 +0000 UTC m=+583.204433335" lastFinishedPulling="2026-05-20 20:29:39.261919134 +0000 UTC m=+585.708501328" observedRunningTime="2026-05-20 20:29:40.044412287 +0000 UTC m=+586.490994504" watchObservedRunningTime="2026-05-20 20:29:40.046853732 +0000 UTC m=+586.493435947"
May 20 20:29:43.788691 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:43.788655    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"]
May 20 20:29:43.792173 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:43.792153    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:29:43.796303 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:43.796280    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x8tdl\""
May 20 20:29:43.803535 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:43.803513    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"]
May 20 20:29:43.891855 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:43.891813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1415831-b0d6-409a-afa3-97da193b42e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" (UID: \"a1415831-b0d6-409a-afa3-97da193b42e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:29:43.891995 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:43.891930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvd7w\" (UniqueName: \"kubernetes.io/projected/a1415831-b0d6-409a-afa3-97da193b42e7-kube-api-access-kvd7w\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" (UID: \"a1415831-b0d6-409a-afa3-97da193b42e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:29:43.992971 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:43.992935    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1415831-b0d6-409a-afa3-97da193b42e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" (UID: \"a1415831-b0d6-409a-afa3-97da193b42e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:29:43.993152 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:43.993003    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvd7w\" (UniqueName: \"kubernetes.io/projected/a1415831-b0d6-409a-afa3-97da193b42e7-kube-api-access-kvd7w\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" (UID: \"a1415831-b0d6-409a-afa3-97da193b42e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:29:43.993428 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:43.993408    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1415831-b0d6-409a-afa3-97da193b42e7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" (UID: \"a1415831-b0d6-409a-afa3-97da193b42e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:29:44.028272 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:44.028246    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvd7w\" (UniqueName: \"kubernetes.io/projected/a1415831-b0d6-409a-afa3-97da193b42e7-kube-api-access-kvd7w\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" (UID: \"a1415831-b0d6-409a-afa3-97da193b42e7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:29:44.102943 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:44.102860    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:29:44.254144 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:44.254105    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"]
May 20 20:29:44.259186 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:29:44.259162    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1415831_b0d6_409a_afa3_97da193b42e7.slice/crio-74c87105b9fbe7c5b8cdd9d0665b638ca27e1d61b93071ebb5ee3c22587cb6f8 WatchSource:0}: Error finding container 74c87105b9fbe7c5b8cdd9d0665b638ca27e1d61b93071ebb5ee3c22587cb6f8: Status 404 returned error can't find the container with id 74c87105b9fbe7c5b8cdd9d0665b638ca27e1d61b93071ebb5ee3c22587cb6f8
May 20 20:29:45.048535 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:45.048490    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" event={"ID":"a1415831-b0d6-409a-afa3-97da193b42e7","Type":"ContainerStarted","Data":"74c87105b9fbe7c5b8cdd9d0665b638ca27e1d61b93071ebb5ee3c22587cb6f8"}
May 20 20:29:48.017853 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:48.017820    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-s9zh8"
May 20 20:29:50.068024 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:50.067989    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" event={"ID":"a1415831-b0d6-409a-afa3-97da193b42e7","Type":"ContainerStarted","Data":"cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de"}
May 20 20:29:50.068476 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:50.068077    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:29:50.095799 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:50.095740    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" podStartSLOduration=2.13344001 podStartE2EDuration="7.095725797s" podCreationTimestamp="2026-05-20 20:29:43 +0000 UTC" firstStartedPulling="2026-05-20 20:29:44.262003561 +0000 UTC m=+590.708585758" lastFinishedPulling="2026-05-20 20:29:49.22428934 +0000 UTC m=+595.670871545" observedRunningTime="2026-05-20 20:29:50.093928981 +0000 UTC m=+596.540511196" watchObservedRunningTime="2026-05-20 20:29:50.095725797 +0000 UTC m=+596.542308013"
May 20 20:29:51.029893 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:51.029859    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-67x7q"
May 20 20:29:54.093890 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:54.093858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:29:54.093890 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:54.093871    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:29:54.100593 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:54.100575    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:29:54.100665 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:29:54.100584    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:30:01.074519 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:01.074490    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:30:02.723952 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.723919    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"]
May 20 20:30:02.733080 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.733044    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"
May 20 20:30:02.749832 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.749808    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"]
May 20 20:30:02.805620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.805589    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"]
May 20 20:30:02.805854 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:30:02.805834    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-b5pp4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5" podUID="1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5"
May 20 20:30:02.812513 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.812485    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"]
May 20 20:30:02.833869 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.833841    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"]
May 20 20:30:02.834113 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.834077    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" containerName="manager" containerID="cri-o://cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de" gracePeriod=2
May 20 20:30:02.852786 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.852750    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"]
May 20 20:30:02.862370 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.862339    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"]
May 20 20:30:02.862714 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.862700    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" containerName="manager"
May 20 20:30:02.862714 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.862714    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" containerName="manager"
May 20 20:30:02.862848 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.862783    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" containerName="manager"
May 20 20:30:02.865006 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.864985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5pp4\" (UniqueName: \"kubernetes.io/projected/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5-kube-api-access-b5pp4\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f2ph5\" (UID: \"1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"
May 20 20:30:02.865109 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.865022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f2ph5\" (UID: \"1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"
May 20 20:30:02.866781 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.866765    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:30:02.878789 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.878761    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"]
May 20 20:30:02.884165 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.884135    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:02.894642 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.894612    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"]
May 20 20:30:02.941639 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.941607    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"]
May 20 20:30:02.942574 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.942542    2575 status_manager.go:895] "Failed to get status for pod" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:02.965631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.965601    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53e25528-c579-4674-af00-d23b6be12b0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k8c5g\" (UID: \"53e25528-c579-4674-af00-d23b6be12b0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:02.965793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.965662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-z54r6\" (UID: \"ffffb18a-4a31-4ba9-b81d-3f1995714ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:30:02.965793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.965690    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr74p\" (UniqueName: \"kubernetes.io/projected/53e25528-c579-4674-af00-d23b6be12b0f-kube-api-access-kr74p\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k8c5g\" (UID: \"53e25528-c579-4674-af00-d23b6be12b0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:02.965793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.965732    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b5pp4\" (UniqueName: \"kubernetes.io/projected/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5-kube-api-access-b5pp4\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f2ph5\" (UID: \"1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"
May 20 20:30:02.965793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.965761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvjc8\" (UniqueName: \"kubernetes.io/projected/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-kube-api-access-pvjc8\") pod \"kuadrant-operator-controller-manager-55c7f4c975-z54r6\" (UID: \"ffffb18a-4a31-4ba9-b81d-3f1995714ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:30:02.965793 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.965789    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f2ph5\" (UID: \"1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"
May 20 20:30:02.966216 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:02.966179    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f2ph5\" (UID: \"1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"
May 20 20:30:02.980933 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:30:02.980852    2575 projected.go:194] Error preparing data for projected volume kube-api-access-b5pp4 for pod kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5: failed to fetch token: pod "kuadrant-operator-controller-manager-55c7f4c975-f2ph5" not found
May 20 20:30:02.980933 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:30:02.980921    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5-kube-api-access-b5pp4 podName:1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5 nodeName:}" failed. No retries permitted until 2026-05-20 20:30:03.480901967 +0000 UTC m=+609.927484163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b5pp4" (UniqueName: "kubernetes.io/projected/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5-kube-api-access-b5pp4") pod "kuadrant-operator-controller-manager-55c7f4c975-f2ph5" (UID: "1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5") : failed to fetch token: pod "kuadrant-operator-controller-manager-55c7f4c975-f2ph5" not found
May 20 20:30:03.022318 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.022277    2575 status_manager.go:895] "Failed to get status for pod" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:03.066576 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.066537    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53e25528-c579-4674-af00-d23b6be12b0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k8c5g\" (UID: \"53e25528-c579-4674-af00-d23b6be12b0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:03.066777 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.066759    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-z54r6\" (UID: \"ffffb18a-4a31-4ba9-b81d-3f1995714ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:30:03.066864 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.066792    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kr74p\" (UniqueName: \"kubernetes.io/projected/53e25528-c579-4674-af00-d23b6be12b0f-kube-api-access-kr74p\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k8c5g\" (UID: \"53e25528-c579-4674-af00-d23b6be12b0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:03.066919 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.066860    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjc8\" (UniqueName: \"kubernetes.io/projected/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-kube-api-access-pvjc8\") pod \"kuadrant-operator-controller-manager-55c7f4c975-z54r6\" (UID: \"ffffb18a-4a31-4ba9-b81d-3f1995714ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:30:03.066968 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.066907    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53e25528-c579-4674-af00-d23b6be12b0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k8c5g\" (UID: \"53e25528-c579-4674-af00-d23b6be12b0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:03.067095 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.067076    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-z54r6\" (UID: \"ffffb18a-4a31-4ba9-b81d-3f1995714ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:30:03.073562 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.073546    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:30:03.076336 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.076312    2575 status_manager.go:895] "Failed to get status for pod" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:03.088517 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.088489    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvjc8\" (UniqueName: \"kubernetes.io/projected/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-kube-api-access-pvjc8\") pod \"kuadrant-operator-controller-manager-55c7f4c975-z54r6\" (UID: \"ffffb18a-4a31-4ba9-b81d-3f1995714ddc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:30:03.089680 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.089659    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr74p\" (UniqueName: \"kubernetes.io/projected/53e25528-c579-4674-af00-d23b6be12b0f-kube-api-access-kr74p\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-k8c5g\" (UID: \"53e25528-c579-4674-af00-d23b6be12b0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:03.113369 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.113341    2575 generic.go:358] "Generic (PLEG): container finished" podID="a1415831-b0d6-409a-afa3-97da193b42e7" containerID="cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de" exitCode=0
May 20 20:30:03.113513 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.113407    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z"
May 20 20:30:03.113513 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.113437    2575 scope.go:117] "RemoveContainer" containerID="cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de"
May 20 20:30:03.113611 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.113585    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"
May 20 20:30:03.118364 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.118337    2575 status_manager.go:895] "Failed to get status for pod" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:03.118642 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.118624    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"
May 20 20:30:03.120526 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.120505    2575 status_manager.go:895] "Failed to get status for pod" podUID="1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-f2ph5\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:03.122069 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.122054    2575 scope.go:117] "RemoveContainer" containerID="cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de"
May 20 20:30:03.122312 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:30:03.122287    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de\": container with ID starting with cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de not found: ID does not exist" containerID="cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de"
May 20 20:30:03.122393 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.122320    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de"} err="failed to get container status \"cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de\": rpc error: code = NotFound desc = could not find container \"cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de\": container with ID starting with cf220b03edc8da44f9c2e2cffa5e0e601ec2e40a1be4f2c9461c94db6b7404de not found: ID does not exist"
May 20 20:30:03.122653 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.122627    2575 status_manager.go:895] "Failed to get status for pod" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:03.129794 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.129775    2575 status_manager.go:895] "Failed to get status for pod" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:03.136243 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.136218    2575 status_manager.go:895] "Failed to get status for pod" podUID="1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-f2ph5\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:03.168011 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.167978    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1415831-b0d6-409a-afa3-97da193b42e7-extensions-socket-volume\") pod \"a1415831-b0d6-409a-afa3-97da193b42e7\" (UID: \"a1415831-b0d6-409a-afa3-97da193b42e7\") "
May 20 20:30:03.168180 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.168020    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvd7w\" (UniqueName: \"kubernetes.io/projected/a1415831-b0d6-409a-afa3-97da193b42e7-kube-api-access-kvd7w\") pod \"a1415831-b0d6-409a-afa3-97da193b42e7\" (UID: \"a1415831-b0d6-409a-afa3-97da193b42e7\") "
May 20 20:30:03.168427 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.168405    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1415831-b0d6-409a-afa3-97da193b42e7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a1415831-b0d6-409a-afa3-97da193b42e7" (UID: "a1415831-b0d6-409a-afa3-97da193b42e7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:30:03.170186 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.170166    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1415831-b0d6-409a-afa3-97da193b42e7-kube-api-access-kvd7w" (OuterVolumeSpecName: "kube-api-access-kvd7w") pod "a1415831-b0d6-409a-afa3-97da193b42e7" (UID: "a1415831-b0d6-409a-afa3-97da193b42e7"). InnerVolumeSpecName "kube-api-access-kvd7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:30:03.221504 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.221464    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:30:03.228265 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.228243    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:03.268714 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.268673    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5-extensions-socket-volume\") pod \"1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5\" (UID: \"1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5\") "
May 20 20:30:03.269243 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.269045    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1415831-b0d6-409a-afa3-97da193b42e7-extensions-socket-volume\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:30:03.269243 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.269067    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvd7w\" (UniqueName: \"kubernetes.io/projected/a1415831-b0d6-409a-afa3-97da193b42e7-kube-api-access-kvd7w\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:30:03.269243 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.269083    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5pp4\" (UniqueName: \"kubernetes.io/projected/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5-kube-api-access-b5pp4\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:30:03.269566 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.269545    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5" (UID: "1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:30:03.369716 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.369688    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5-extensions-socket-volume\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:30:03.382490 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.382417    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"]
May 20 20:30:03.384799 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:30:03.384774    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffffb18a_4a31_4ba9_b81d_3f1995714ddc.slice/crio-72e092624fef5199e733d844f07503381ead13f57060660771b1a2a772749dcc WatchSource:0}: Error finding container 72e092624fef5199e733d844f07503381ead13f57060660771b1a2a772749dcc: Status 404 returned error can't find the container with id 72e092624fef5199e733d844f07503381ead13f57060660771b1a2a772749dcc
May 20 20:30:03.387039 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.387023    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:30:03.425054 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.425018    2575 status_manager.go:895] "Failed to get status for pod" podUID="1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-f2ph5\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:03.426575 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.426553    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"]
May 20 20:30:03.426715 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:30:03.426694    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e25528_c579_4674_af00_d23b6be12b0f.slice/crio-59c6e79a7e5170c0adef021e68fd6eedcaf1ee7dc7ed2784a3591239e695385f WatchSource:0}: Error finding container 59c6e79a7e5170c0adef021e68fd6eedcaf1ee7dc7ed2784a3591239e695385f: Status 404 returned error can't find the container with id 59c6e79a7e5170c0adef021e68fd6eedcaf1ee7dc7ed2784a3591239e695385f
May 20 20:30:03.428904 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:03.428873    2575 status_manager.go:895] "Failed to get status for pod" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:04.120024 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.119945    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6" event={"ID":"ffffb18a-4a31-4ba9-b81d-3f1995714ddc","Type":"ContainerStarted","Data":"bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3"}
May 20 20:30:04.120024 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.119981    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6" event={"ID":"ffffb18a-4a31-4ba9-b81d-3f1995714ddc","Type":"ContainerStarted","Data":"72e092624fef5199e733d844f07503381ead13f57060660771b1a2a772749dcc"}
May 20 20:30:04.120502 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.120034    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:30:04.121345 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.121329    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5"
May 20 20:30:04.121455 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.121373    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g" event={"ID":"53e25528-c579-4674-af00-d23b6be12b0f","Type":"ContainerStarted","Data":"e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb"}
May 20 20:30:04.121455 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.121412    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g" event={"ID":"53e25528-c579-4674-af00-d23b6be12b0f","Type":"ContainerStarted","Data":"59c6e79a7e5170c0adef021e68fd6eedcaf1ee7dc7ed2784a3591239e695385f"}
May 20 20:30:04.143032 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.142986    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6" podStartSLOduration=2.142972126 podStartE2EDuration="2.142972126s" podCreationTimestamp="2026-05-20 20:30:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:30:04.141826109 +0000 UTC m=+610.588408326" watchObservedRunningTime="2026-05-20 20:30:04.142972126 +0000 UTC m=+610.589554344"
May 20 20:30:04.143836 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.143810    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5" path="/var/lib/kubelet/pods/1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5/volumes"
May 20 20:30:04.143993 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.143815    2575 status_manager.go:895] "Failed to get status for pod" podUID="1d1f1ef7-1a8a-4266-8f1a-efdb8741c2e5" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f2ph5" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-f2ph5\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:04.144142 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.144121    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" path="/var/lib/kubelet/pods/a1415831-b0d6-409a-afa3-97da193b42e7/volumes"
May 20 20:30:04.145664 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.145644    2575 status_manager.go:895] "Failed to get status for pod" podUID="a1415831-b0d6-409a-afa3-97da193b42e7" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pd57z" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pd57z\" is forbidden: User \"system:node:ip-10-0-138-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-220.ec2.internal' and this object"
May 20 20:30:04.172698 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:04.172660    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g" podStartSLOduration=2.172649653 podStartE2EDuration="2.172649653s" podCreationTimestamp="2026-05-20 20:30:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:30:04.169938263 +0000 UTC m=+610.616520480" watchObservedRunningTime="2026-05-20 20:30:04.172649653 +0000 UTC m=+610.619231848"
May 20 20:30:05.125053 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:05.125022    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:15.126895 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:15.126820    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:30:15.281478 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:15.281441    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"]
May 20 20:30:15.281733 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:15.281694    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g" podUID="53e25528-c579-4674-af00-d23b6be12b0f" containerName="manager" containerID="cri-o://e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb" gracePeriod=10
May 20 20:30:15.283571 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:15.283545    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:15.538487 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:15.538457    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:15.586133 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:15.586098    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr74p\" (UniqueName: \"kubernetes.io/projected/53e25528-c579-4674-af00-d23b6be12b0f-kube-api-access-kr74p\") pod \"53e25528-c579-4674-af00-d23b6be12b0f\" (UID: \"53e25528-c579-4674-af00-d23b6be12b0f\") "
May 20 20:30:15.586346 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:15.586259    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53e25528-c579-4674-af00-d23b6be12b0f-extensions-socket-volume\") pod \"53e25528-c579-4674-af00-d23b6be12b0f\" (UID: \"53e25528-c579-4674-af00-d23b6be12b0f\") "
May 20 20:30:15.586704 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:15.586663    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e25528-c579-4674-af00-d23b6be12b0f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "53e25528-c579-4674-af00-d23b6be12b0f" (UID: "53e25528-c579-4674-af00-d23b6be12b0f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:30:15.588566 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:15.588538    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e25528-c579-4674-af00-d23b6be12b0f-kube-api-access-kr74p" (OuterVolumeSpecName: "kube-api-access-kr74p") pod "53e25528-c579-4674-af00-d23b6be12b0f" (UID: "53e25528-c579-4674-af00-d23b6be12b0f"). InnerVolumeSpecName "kube-api-access-kr74p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:30:15.686951 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:15.686867    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53e25528-c579-4674-af00-d23b6be12b0f-extensions-socket-volume\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:30:15.686951 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:15.686895    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr74p\" (UniqueName: \"kubernetes.io/projected/53e25528-c579-4674-af00-d23b6be12b0f-kube-api-access-kr74p\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:30:16.162857 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:16.162827    2575 generic.go:358] "Generic (PLEG): container finished" podID="53e25528-c579-4674-af00-d23b6be12b0f" containerID="e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb" exitCode=0
May 20 20:30:16.163296 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:16.162875    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g" event={"ID":"53e25528-c579-4674-af00-d23b6be12b0f","Type":"ContainerDied","Data":"e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb"}
May 20 20:30:16.163296 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:16.162889    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"
May 20 20:30:16.163296 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:16.162903    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g" event={"ID":"53e25528-c579-4674-af00-d23b6be12b0f","Type":"ContainerDied","Data":"59c6e79a7e5170c0adef021e68fd6eedcaf1ee7dc7ed2784a3591239e695385f"}
May 20 20:30:16.163296 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:16.162922    2575 scope.go:117] "RemoveContainer" containerID="e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb"
May 20 20:30:16.170823 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:16.170796    2575 scope.go:117] "RemoveContainer" containerID="e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb"
May 20 20:30:16.171068 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:30:16.171046    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb\": container with ID starting with e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb not found: ID does not exist" containerID="e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb"
May 20 20:30:16.171131 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:16.171076    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb"} err="failed to get container status \"e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb\": rpc error: code = NotFound desc = could not find container \"e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb\": container with ID starting with e7f3cbf74c3ee236f6b8950350fe6b06ce77659d56a9d72ae9522882ae2738fb not found: ID does not exist"
May 20 20:30:16.193560 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:16.193528    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"]
May 20 20:30:16.202492 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:16.202466    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-k8c5g"]
May 20 20:30:18.148904 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:18.148858    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53e25528-c579-4674-af00-d23b6be12b0f" path="/var/lib/kubelet/pods/53e25528-c579-4674-af00-d23b6be12b0f/volumes"
May 20 20:30:31.732279 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.732244    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"]
May 20 20:30:31.732868 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.732845    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e25528-c579-4674-af00-d23b6be12b0f" containerName="manager"
May 20 20:30:31.732966 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.732870    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e25528-c579-4674-af00-d23b6be12b0f" containerName="manager"
May 20 20:30:31.732966 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.732951    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="53e25528-c579-4674-af00-d23b6be12b0f" containerName="manager"
May 20 20:30:31.736367 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.736345    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.739053 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.739030    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-72zbf\""
May 20 20:30:31.754644 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.754615    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"]
May 20 20:30:31.824933 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.824899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.824933 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.824937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.825171 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.824954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.825171 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.824975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.825171 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.825017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.825171 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.825115    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.825171 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.825146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8h6l\" (UniqueName: \"kubernetes.io/projected/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-kube-api-access-j8h6l\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.825659 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.825179    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.825659 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.825283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926284 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926248    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926469 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926292    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8h6l\" (UniqueName: \"kubernetes.io/projected/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-kube-api-access-j8h6l\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926469 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926334    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926469 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926389    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926469 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926435    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926469 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926462    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926717 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926483    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926717 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926618    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926717 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926646    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926717 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926695    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926912 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926745    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.926912 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926838    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.927003 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.926953    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.927136 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.927117    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.928617 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.928595    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.928909 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.928893    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.937526 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.937500    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8h6l\" (UniqueName: \"kubernetes.io/projected/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-kube-api-access-j8h6l\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:31.938544 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:31.938526    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ed96c21-22ba-4202-8d4b-7efb1b6dc03c-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jmxnv\" (UID: \"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:32.047107 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:32.047021    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:32.181794 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:32.181757    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"]
May 20 20:30:32.185892 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:30:32.185859    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed96c21_22ba_4202_8d4b_7efb1b6dc03c.slice/crio-d4c082c99a5f2ead64f30e413ecb69706e0ea97f11d301242236878b77542876 WatchSource:0}: Error finding container d4c082c99a5f2ead64f30e413ecb69706e0ea97f11d301242236878b77542876: Status 404 returned error can't find the container with id d4c082c99a5f2ead64f30e413ecb69706e0ea97f11d301242236878b77542876
May 20 20:30:32.187880 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:32.187846    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 20 20:30:32.187935 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:32.187905    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 20 20:30:32.187935 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:32.187931    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 20 20:30:32.219052 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:32.219027    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv" event={"ID":"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c","Type":"ContainerStarted","Data":"d4c082c99a5f2ead64f30e413ecb69706e0ea97f11d301242236878b77542876"}
May 20 20:30:33.224815 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:33.224777    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv" event={"ID":"6ed96c21-22ba-4202-8d4b-7efb1b6dc03c","Type":"ContainerStarted","Data":"e8700063456c3902ae86558be398c4e8a331cc37a387f057c84b69dae4a6ec0e"}
May 20 20:30:33.250851 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:33.250799    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv" podStartSLOduration=2.250784323 podStartE2EDuration="2.250784323s" podCreationTimestamp="2026-05-20 20:30:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:30:33.250277416 +0000 UTC m=+639.696859631" watchObservedRunningTime="2026-05-20 20:30:33.250784323 +0000 UTC m=+639.697366538"
May 20 20:30:34.048226 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:34.048148    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:34.052758 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:34.052734    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:34.227656 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:34.227625    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:34.228808 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:34.228778    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jmxnv"
May 20 20:30:37.080223 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:37.080158    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-ss6pl"]
May 20 20:30:37.083790 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:37.083775    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ss6pl"
May 20 20:30:37.086403 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:37.086383    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8pq47\""
May 20 20:30:37.094749 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:37.094726    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-ss6pl"]
May 20 20:30:37.175649 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:37.175596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vfct\" (UniqueName: \"kubernetes.io/projected/a1a2b7c5-ad00-4f75-82f1-2efbbea640d3-kube-api-access-2vfct\") pod \"authorino-7498df8756-ss6pl\" (UID: \"a1a2b7c5-ad00-4f75-82f1-2efbbea640d3\") " pod="kuadrant-system/authorino-7498df8756-ss6pl"
May 20 20:30:37.277027 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:37.276994    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vfct\" (UniqueName: \"kubernetes.io/projected/a1a2b7c5-ad00-4f75-82f1-2efbbea640d3-kube-api-access-2vfct\") pod \"authorino-7498df8756-ss6pl\" (UID: \"a1a2b7c5-ad00-4f75-82f1-2efbbea640d3\") " pod="kuadrant-system/authorino-7498df8756-ss6pl"
May 20 20:30:37.284992 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:37.284967    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vfct\" (UniqueName: \"kubernetes.io/projected/a1a2b7c5-ad00-4f75-82f1-2efbbea640d3-kube-api-access-2vfct\") pod \"authorino-7498df8756-ss6pl\" (UID: \"a1a2b7c5-ad00-4f75-82f1-2efbbea640d3\") " pod="kuadrant-system/authorino-7498df8756-ss6pl"
May 20 20:30:37.393764 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:37.393731    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ss6pl"
May 20 20:30:37.525667 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:37.525641    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-ss6pl"]
May 20 20:30:37.528127 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:30:37.528098    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1a2b7c5_ad00_4f75_82f1_2efbbea640d3.slice/crio-81bdd66ffa00b9c476a4e4155177d7c29324389537732f533c82e9d87738b84a WatchSource:0}: Error finding container 81bdd66ffa00b9c476a4e4155177d7c29324389537732f533c82e9d87738b84a: Status 404 returned error can't find the container with id 81bdd66ffa00b9c476a4e4155177d7c29324389537732f533c82e9d87738b84a
May 20 20:30:38.243174 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:38.243111    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ss6pl" event={"ID":"a1a2b7c5-ad00-4f75-82f1-2efbbea640d3","Type":"ContainerStarted","Data":"81bdd66ffa00b9c476a4e4155177d7c29324389537732f533c82e9d87738b84a"}
May 20 20:30:41.256500 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:41.256460    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ss6pl" event={"ID":"a1a2b7c5-ad00-4f75-82f1-2efbbea640d3","Type":"ContainerStarted","Data":"4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b"}
May 20 20:30:41.275918 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:30:41.275863    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-ss6pl" podStartSLOduration=0.952069237 podStartE2EDuration="4.27584957s" podCreationTimestamp="2026-05-20 20:30:37 +0000 UTC" firstStartedPulling="2026-05-20 20:30:37.529346005 +0000 UTC m=+643.975928200" lastFinishedPulling="2026-05-20 20:30:40.853126334 +0000 UTC m=+647.299708533" observedRunningTime="2026-05-20 20:30:41.273510726 +0000 UTC m=+647.720092941" watchObservedRunningTime="2026-05-20 20:30:41.27584957 +0000 UTC m=+647.722431765"
May 20 20:31:41.342398 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.342364    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:31:41.346070 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.346046    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 20:31:41.348633 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.348607    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 20 20:31:41.348763 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.348609    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
May 20 20:31:41.348763 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.348709    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 20 20:31:41.349461 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.349446    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-79fhq\""
May 20 20:31:41.354509 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.354487    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:31:41.476521 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.476490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mmsr\" (UniqueName: \"kubernetes.io/projected/4577fea6-37b0-4583-9656-9032a0ae567c-kube-api-access-5mmsr\") pod \"maas-keycloak-0\" (UID: \"4577fea6-37b0-4583-9656-9032a0ae567c\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:31:41.577569 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.577533    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5mmsr\" (UniqueName: \"kubernetes.io/projected/4577fea6-37b0-4583-9656-9032a0ae567c-kube-api-access-5mmsr\") pod \"maas-keycloak-0\" (UID: \"4577fea6-37b0-4583-9656-9032a0ae567c\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:31:41.585747 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.585717    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mmsr\" (UniqueName: \"kubernetes.io/projected/4577fea6-37b0-4583-9656-9032a0ae567c-kube-api-access-5mmsr\") pod \"maas-keycloak-0\" (UID: \"4577fea6-37b0-4583-9656-9032a0ae567c\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:31:41.656775 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.656739    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 20:31:41.794704 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:41.794474    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:31:41.797086 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:31:41.797056    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4577fea6_37b0_4583_9656_9032a0ae567c.slice/crio-163c00b4c53948bcb703d735c105d322b8b5199f6abd33dda282c56eddcf2b97 WatchSource:0}: Error finding container 163c00b4c53948bcb703d735c105d322b8b5199f6abd33dda282c56eddcf2b97: Status 404 returned error can't find the container with id 163c00b4c53948bcb703d735c105d322b8b5199f6abd33dda282c56eddcf2b97
May 20 20:31:42.477036 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:42.477001    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4577fea6-37b0-4583-9656-9032a0ae567c","Type":"ContainerStarted","Data":"163c00b4c53948bcb703d735c105d322b8b5199f6abd33dda282c56eddcf2b97"}
May 20 20:31:47.501309 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:47.501263    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4577fea6-37b0-4583-9656-9032a0ae567c","Type":"ContainerStarted","Data":"754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e"}
May 20 20:31:47.522405 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:47.522343    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.2544859179999999 podStartE2EDuration="6.522325683s" podCreationTimestamp="2026-05-20 20:31:41 +0000 UTC" firstStartedPulling="2026-05-20 20:31:41.798318195 +0000 UTC m=+708.244900390" lastFinishedPulling="2026-05-20 20:31:47.066157956 +0000 UTC m=+713.512740155" observedRunningTime="2026-05-20 20:31:47.519910287 +0000 UTC m=+713.966492504" watchObservedRunningTime="2026-05-20 20:31:47.522325683 +0000 UTC m=+713.968907901"
May 20 20:31:47.657413 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:47.657368    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
May 20 20:31:47.659011 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:47.658981    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:48.658253 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:48.658176    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:49.657826 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:49.657777    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:50.658135 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:50.658078    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:51.657906 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:51.657858    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
May 20 20:31:51.658297 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:51.658261    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:52.657740 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:52.657689    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:53.658162 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:53.658082    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:54.658089 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:54.658038    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:55.657743 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:55.657695    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:56.657759 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:56.657698    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:57.657815 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:57.657757    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:58.657595 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:58.657553    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:31:59.657344 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:31:59.657299    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused"
May 20 20:32:00.790693 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:00.790641    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
May 20 20:32:00.811315 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:00.811245    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:32:10.796620 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:10.796583    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
May 20 20:32:14.228076 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.228043    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-ss6pl"]
May 20 20:32:14.228589 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.228281    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-ss6pl" podUID="a1a2b7c5-ad00-4f75-82f1-2efbbea640d3" containerName="authorino" containerID="cri-o://4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b" gracePeriod=30
May 20 20:32:14.477303 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.477280    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ss6pl"
May 20 20:32:14.535688 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.535598    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vfct\" (UniqueName: \"kubernetes.io/projected/a1a2b7c5-ad00-4f75-82f1-2efbbea640d3-kube-api-access-2vfct\") pod \"a1a2b7c5-ad00-4f75-82f1-2efbbea640d3\" (UID: \"a1a2b7c5-ad00-4f75-82f1-2efbbea640d3\") "
May 20 20:32:14.537639 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.537617    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1a2b7c5-ad00-4f75-82f1-2efbbea640d3-kube-api-access-2vfct" (OuterVolumeSpecName: "kube-api-access-2vfct") pod "a1a2b7c5-ad00-4f75-82f1-2efbbea640d3" (UID: "a1a2b7c5-ad00-4f75-82f1-2efbbea640d3"). InnerVolumeSpecName "kube-api-access-2vfct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:32:14.616320 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.616288    2575 generic.go:358] "Generic (PLEG): container finished" podID="a1a2b7c5-ad00-4f75-82f1-2efbbea640d3" containerID="4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b" exitCode=0
May 20 20:32:14.616510 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.616344    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ss6pl"
May 20 20:32:14.616510 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.616370    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ss6pl" event={"ID":"a1a2b7c5-ad00-4f75-82f1-2efbbea640d3","Type":"ContainerDied","Data":"4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b"}
May 20 20:32:14.616510 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.616421    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ss6pl" event={"ID":"a1a2b7c5-ad00-4f75-82f1-2efbbea640d3","Type":"ContainerDied","Data":"81bdd66ffa00b9c476a4e4155177d7c29324389537732f533c82e9d87738b84a"}
May 20 20:32:14.616510 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.616436    2575 scope.go:117] "RemoveContainer" containerID="4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b"
May 20 20:32:14.625261 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.625243    2575 scope.go:117] "RemoveContainer" containerID="4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b"
May 20 20:32:14.625502 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:32:14.625486    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b\": container with ID starting with 4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b not found: ID does not exist" containerID="4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b"
May 20 20:32:14.625544 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.625509    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b"} err="failed to get container status \"4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b\": rpc error: code = NotFound desc = could not find container \"4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b\": container with ID starting with 4b551cd2ebfb9b329ae4da510473f9105cc92e19c765e6a231590385117efc6b not found: ID does not exist"
May 20 20:32:14.636339 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.636312    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vfct\" (UniqueName: \"kubernetes.io/projected/a1a2b7c5-ad00-4f75-82f1-2efbbea640d3-kube-api-access-2vfct\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:32:14.640812 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.640790    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-ss6pl"]
May 20 20:32:14.642839 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:14.642816    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-ss6pl"]
May 20 20:32:16.144072 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:16.144040    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1a2b7c5-ad00-4f75-82f1-2efbbea640d3" path="/var/lib/kubelet/pods/a1a2b7c5-ad00-4f75-82f1-2efbbea640d3/volumes"
May 20 20:32:17.216386 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.216356    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mgkcd"]
May 20 20:32:17.216748 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.216723    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a2b7c5-ad00-4f75-82f1-2efbbea640d3" containerName="authorino"
May 20 20:32:17.216748 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.216735    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a2b7c5-ad00-4f75-82f1-2efbbea640d3" containerName="authorino"
May 20 20:32:17.216821 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.216811    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1a2b7c5-ad00-4f75-82f1-2efbbea640d3" containerName="authorino"
May 20 20:32:17.218741 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.218724    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mgkcd"
May 20 20:32:17.225730 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.225709    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sglhc\""
May 20 20:32:17.232018 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.231999    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 20 20:32:17.248867 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.248836    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mgkcd"]
May 20 20:32:17.258812 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.258788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcsl4\" (UniqueName: \"kubernetes.io/projected/28e14d0d-558c-4909-8802-967bdedef634-kube-api-access-mcsl4\") pod \"maas-controller-68fb5d86bc-mgkcd\" (UID: \"28e14d0d-558c-4909-8802-967bdedef634\") " pod="opendatahub/maas-controller-68fb5d86bc-mgkcd"
May 20 20:32:17.359478 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.359432    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcsl4\" (UniqueName: \"kubernetes.io/projected/28e14d0d-558c-4909-8802-967bdedef634-kube-api-access-mcsl4\") pod \"maas-controller-68fb5d86bc-mgkcd\" (UID: \"28e14d0d-558c-4909-8802-967bdedef634\") " pod="opendatahub/maas-controller-68fb5d86bc-mgkcd"
May 20 20:32:17.380321 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.380283    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcsl4\" (UniqueName: \"kubernetes.io/projected/28e14d0d-558c-4909-8802-967bdedef634-kube-api-access-mcsl4\") pod \"maas-controller-68fb5d86bc-mgkcd\" (UID: \"28e14d0d-558c-4909-8802-967bdedef634\") " pod="opendatahub/maas-controller-68fb5d86bc-mgkcd"
May 20 20:32:17.437958 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.437925    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-785f576c9c-628g5"]
May 20 20:32:17.441065 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.441046    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785f576c9c-628g5"
May 20 20:32:17.451807 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.451775    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785f576c9c-628g5"]
May 20 20:32:17.460702 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.460667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9z2c\" (UniqueName: \"kubernetes.io/projected/9ff1f26b-f117-4527-a8b5-0694c0c327fc-kube-api-access-z9z2c\") pod \"maas-controller-785f576c9c-628g5\" (UID: \"9ff1f26b-f117-4527-a8b5-0694c0c327fc\") " pod="opendatahub/maas-controller-785f576c9c-628g5"
May 20 20:32:17.528753 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.528639    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mgkcd"
May 20 20:32:17.530298 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.530279    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mgkcd"]
May 20 20:32:17.561391 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.561355    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9z2c\" (UniqueName: \"kubernetes.io/projected/9ff1f26b-f117-4527-a8b5-0694c0c327fc-kube-api-access-z9z2c\") pod \"maas-controller-785f576c9c-628g5\" (UID: \"9ff1f26b-f117-4527-a8b5-0694c0c327fc\") " pod="opendatahub/maas-controller-785f576c9c-628g5"
May 20 20:32:17.568519 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.568469    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b48d64b66-cxbbn"]
May 20 20:32:17.572511 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.572475    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b48d64b66-cxbbn"
May 20 20:32:17.575869 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.575831    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9z2c\" (UniqueName: \"kubernetes.io/projected/9ff1f26b-f117-4527-a8b5-0694c0c327fc-kube-api-access-z9z2c\") pod \"maas-controller-785f576c9c-628g5\" (UID: \"9ff1f26b-f117-4527-a8b5-0694c0c327fc\") " pod="opendatahub/maas-controller-785f576c9c-628g5"
May 20 20:32:17.583357 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.583325    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b48d64b66-cxbbn"]
May 20 20:32:17.666978 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.666913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gljlp\" (UniqueName: \"kubernetes.io/projected/5ebfbfa9-a9b4-4d47-b123-9523415adc0a-kube-api-access-gljlp\") pod \"maas-controller-7b48d64b66-cxbbn\" (UID: \"5ebfbfa9-a9b4-4d47-b123-9523415adc0a\") " pod="opendatahub/maas-controller-7b48d64b66-cxbbn"
May 20 20:32:17.721591 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.721548    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mgkcd"]
May 20 20:32:17.724823 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:32:17.724786    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e14d0d_558c_4909_8802_967bdedef634.slice/crio-ae6075fe7a3e942d9922a47e35c520ef622123cc27719b24bf9fe954514ba5c1 WatchSource:0}: Error finding container ae6075fe7a3e942d9922a47e35c520ef622123cc27719b24bf9fe954514ba5c1: Status 404 returned error can't find the container with id ae6075fe7a3e942d9922a47e35c520ef622123cc27719b24bf9fe954514ba5c1
May 20 20:32:17.754458 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.754420    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785f576c9c-628g5"
May 20 20:32:17.767657 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.767624    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gljlp\" (UniqueName: \"kubernetes.io/projected/5ebfbfa9-a9b4-4d47-b123-9523415adc0a-kube-api-access-gljlp\") pod \"maas-controller-7b48d64b66-cxbbn\" (UID: \"5ebfbfa9-a9b4-4d47-b123-9523415adc0a\") " pod="opendatahub/maas-controller-7b48d64b66-cxbbn"
May 20 20:32:17.776964 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.776939    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gljlp\" (UniqueName: \"kubernetes.io/projected/5ebfbfa9-a9b4-4d47-b123-9523415adc0a-kube-api-access-gljlp\") pod \"maas-controller-7b48d64b66-cxbbn\" (UID: \"5ebfbfa9-a9b4-4d47-b123-9523415adc0a\") " pod="opendatahub/maas-controller-7b48d64b66-cxbbn"
May 20 20:32:17.887604 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.887579    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-785f576c9c-628g5"]
May 20 20:32:17.889516 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:32:17.889491    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff1f26b_f117_4527_a8b5_0694c0c327fc.slice/crio-cdc0f4fe1a72759fbdda6313441304f71464408e44f7891257ac535c998b1547 WatchSource:0}: Error finding container cdc0f4fe1a72759fbdda6313441304f71464408e44f7891257ac535c998b1547: Status 404 returned error can't find the container with id cdc0f4fe1a72759fbdda6313441304f71464408e44f7891257ac535c998b1547
May 20 20:32:17.908887 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:17.908850    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b48d64b66-cxbbn"
May 20 20:32:18.041607 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:18.041540    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b48d64b66-cxbbn"]
May 20 20:32:18.044281 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:32:18.044249    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ebfbfa9_a9b4_4d47_b123_9523415adc0a.slice/crio-75027a31a89bf14c02be4cdd7b3778631df87fc87df018fe90d4ac9ab7a2fcdd WatchSource:0}: Error finding container 75027a31a89bf14c02be4cdd7b3778631df87fc87df018fe90d4ac9ab7a2fcdd: Status 404 returned error can't find the container with id 75027a31a89bf14c02be4cdd7b3778631df87fc87df018fe90d4ac9ab7a2fcdd
May 20 20:32:18.638520 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:18.638409    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b48d64b66-cxbbn" event={"ID":"5ebfbfa9-a9b4-4d47-b123-9523415adc0a","Type":"ContainerStarted","Data":"75027a31a89bf14c02be4cdd7b3778631df87fc87df018fe90d4ac9ab7a2fcdd"}
May 20 20:32:18.642526 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:18.642491    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-mgkcd" event={"ID":"28e14d0d-558c-4909-8802-967bdedef634","Type":"ContainerStarted","Data":"ae6075fe7a3e942d9922a47e35c520ef622123cc27719b24bf9fe954514ba5c1"}
May 20 20:32:18.645143 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:18.645081    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785f576c9c-628g5" event={"ID":"9ff1f26b-f117-4527-a8b5-0694c0c327fc","Type":"ContainerStarted","Data":"cdc0f4fe1a72759fbdda6313441304f71464408e44f7891257ac535c998b1547"}
May 20 20:32:22.665114 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:22.665073    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b48d64b66-cxbbn" event={"ID":"5ebfbfa9-a9b4-4d47-b123-9523415adc0a","Type":"ContainerStarted","Data":"7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15"}
May 20 20:32:22.665601 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:22.665131    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b48d64b66-cxbbn"
May 20 20:32:22.666469 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:22.666445    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-mgkcd" event={"ID":"28e14d0d-558c-4909-8802-967bdedef634","Type":"ContainerStarted","Data":"e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46"}
May 20 20:32:22.666560 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:22.666486    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fb5d86bc-mgkcd"
May 20 20:32:22.666560 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:22.666508    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-68fb5d86bc-mgkcd" podUID="28e14d0d-558c-4909-8802-967bdedef634" containerName="manager" containerID="cri-o://e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46" gracePeriod=30
May 20 20:32:22.670801 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:22.670769    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785f576c9c-628g5" event={"ID":"9ff1f26b-f117-4527-a8b5-0694c0c327fc","Type":"ContainerStarted","Data":"49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76"}
May 20 20:32:22.670909 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:22.670892    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-785f576c9c-628g5"
May 20 20:32:22.686167 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:22.686115    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7b48d64b66-cxbbn" podStartSLOduration=1.896112413 podStartE2EDuration="5.686098893s" podCreationTimestamp="2026-05-20 20:32:17 +0000 UTC" firstStartedPulling="2026-05-20 20:32:18.045647414 +0000 UTC m=+744.492229611" lastFinishedPulling="2026-05-20 20:32:21.835633896 +0000 UTC m=+748.282216091" observedRunningTime="2026-05-20 20:32:22.684804 +0000 UTC m=+749.131386218" watchObservedRunningTime="2026-05-20 20:32:22.686098893 +0000 UTC m=+749.132681088"
May 20 20:32:22.702929 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:22.702864    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-785f576c9c-628g5" podStartSLOduration=1.769402795 podStartE2EDuration="5.702845842s" podCreationTimestamp="2026-05-20 20:32:17 +0000 UTC" firstStartedPulling="2026-05-20 20:32:17.890802672 +0000 UTC m=+744.337384867" lastFinishedPulling="2026-05-20 20:32:21.824245716 +0000 UTC m=+748.270827914" observedRunningTime="2026-05-20 20:32:22.702578284 +0000 UTC m=+749.149160512" watchObservedRunningTime="2026-05-20 20:32:22.702845842 +0000 UTC m=+749.149428059"
May 20 20:32:22.722724 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:22.722665    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-68fb5d86bc-mgkcd" podStartSLOduration=1.659547067 podStartE2EDuration="5.722640472s" podCreationTimestamp="2026-05-20 20:32:17 +0000 UTC" firstStartedPulling="2026-05-20 20:32:17.726050378 +0000 UTC m=+744.172632573" lastFinishedPulling="2026-05-20 20:32:21.78914378 +0000 UTC m=+748.235725978" observedRunningTime="2026-05-20 20:32:22.72081554 +0000 UTC m=+749.167397758" watchObservedRunningTime="2026-05-20 20:32:22.722640472 +0000 UTC m=+749.169222692"
May 20 20:32:22.921223 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:22.921127    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mgkcd"
May 20 20:32:23.020730 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.020690    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcsl4\" (UniqueName: \"kubernetes.io/projected/28e14d0d-558c-4909-8802-967bdedef634-kube-api-access-mcsl4\") pod \"28e14d0d-558c-4909-8802-967bdedef634\" (UID: \"28e14d0d-558c-4909-8802-967bdedef634\") "
May 20 20:32:23.022930 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.022900    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28e14d0d-558c-4909-8802-967bdedef634-kube-api-access-mcsl4" (OuterVolumeSpecName: "kube-api-access-mcsl4") pod "28e14d0d-558c-4909-8802-967bdedef634" (UID: "28e14d0d-558c-4909-8802-967bdedef634"). InnerVolumeSpecName "kube-api-access-mcsl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:32:23.121844 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.121803    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcsl4\" (UniqueName: \"kubernetes.io/projected/28e14d0d-558c-4909-8802-967bdedef634-kube-api-access-mcsl4\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:32:23.675950 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.675913    2575 generic.go:358] "Generic (PLEG): container finished" podID="28e14d0d-558c-4909-8802-967bdedef634" containerID="e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46" exitCode=0
May 20 20:32:23.676433 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.676005    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-mgkcd"
May 20 20:32:23.676433 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.676004    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-mgkcd" event={"ID":"28e14d0d-558c-4909-8802-967bdedef634","Type":"ContainerDied","Data":"e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46"}
May 20 20:32:23.676433 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.676117    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-mgkcd" event={"ID":"28e14d0d-558c-4909-8802-967bdedef634","Type":"ContainerDied","Data":"ae6075fe7a3e942d9922a47e35c520ef622123cc27719b24bf9fe954514ba5c1"}
May 20 20:32:23.676433 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.676140    2575 scope.go:117] "RemoveContainer" containerID="e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46"
May 20 20:32:23.684973 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.684956    2575 scope.go:117] "RemoveContainer" containerID="e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46"
May 20 20:32:23.685243 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:32:23.685227    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46\": container with ID starting with e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46 not found: ID does not exist" containerID="e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46"
May 20 20:32:23.685302 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.685251    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46"} err="failed to get container status \"e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46\": rpc error: code = NotFound desc = could not find container \"e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46\": container with ID starting with e8852cc421c16ee3e5ab055bfd0d657b22c77cc3a970e271572e75c086827c46 not found: ID does not exist"
May 20 20:32:23.697699 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.697673    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mgkcd"]
May 20 20:32:23.701768 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:23.701747    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-mgkcd"]
May 20 20:32:24.143732 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:24.143694    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28e14d0d-558c-4909-8802-967bdedef634" path="/var/lib/kubelet/pods/28e14d0d-558c-4909-8802-967bdedef634/volumes"
May 20 20:32:33.681662 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:33.681620    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-785f576c9c-628g5"
May 20 20:32:33.682074 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:33.681934    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b48d64b66-cxbbn"
May 20 20:32:33.781996 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:33.781963    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-785f576c9c-628g5"]
May 20 20:32:33.782288 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:33.782234    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-785f576c9c-628g5" podUID="9ff1f26b-f117-4527-a8b5-0694c0c327fc" containerName="manager" containerID="cri-o://49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76" gracePeriod=30
May 20 20:32:33.947172 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:33.946805    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75c4bf7446-ph2c6"]
May 20 20:32:33.947461 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:33.947440    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28e14d0d-558c-4909-8802-967bdedef634" containerName="manager"
May 20 20:32:33.947461 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:33.947460    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e14d0d-558c-4909-8802-967bdedef634" containerName="manager"
May 20 20:32:33.947648 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:33.947588    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="28e14d0d-558c-4909-8802-967bdedef634" containerName="manager"
May 20 20:32:33.950138 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:33.950114    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c4bf7446-ph2c6"
May 20 20:32:33.958777 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:33.958752    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c4bf7446-ph2c6"]
May 20 20:32:34.019317 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.019295    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785f576c9c-628g5"
May 20 20:32:34.021672 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.021653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwvtg\" (UniqueName: \"kubernetes.io/projected/7de029b2-c874-4bcb-a6d3-89333999798b-kube-api-access-jwvtg\") pod \"maas-controller-75c4bf7446-ph2c6\" (UID: \"7de029b2-c874-4bcb-a6d3-89333999798b\") " pod="opendatahub/maas-controller-75c4bf7446-ph2c6"
May 20 20:32:34.122287 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.122253    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9z2c\" (UniqueName: \"kubernetes.io/projected/9ff1f26b-f117-4527-a8b5-0694c0c327fc-kube-api-access-z9z2c\") pod \"9ff1f26b-f117-4527-a8b5-0694c0c327fc\" (UID: \"9ff1f26b-f117-4527-a8b5-0694c0c327fc\") "
May 20 20:32:34.122459 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.122437    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwvtg\" (UniqueName: \"kubernetes.io/projected/7de029b2-c874-4bcb-a6d3-89333999798b-kube-api-access-jwvtg\") pod \"maas-controller-75c4bf7446-ph2c6\" (UID: \"7de029b2-c874-4bcb-a6d3-89333999798b\") " pod="opendatahub/maas-controller-75c4bf7446-ph2c6"
May 20 20:32:34.124395 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.124365    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff1f26b-f117-4527-a8b5-0694c0c327fc-kube-api-access-z9z2c" (OuterVolumeSpecName: "kube-api-access-z9z2c") pod "9ff1f26b-f117-4527-a8b5-0694c0c327fc" (UID: "9ff1f26b-f117-4527-a8b5-0694c0c327fc"). InnerVolumeSpecName "kube-api-access-z9z2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:32:34.131089 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.131069    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwvtg\" (UniqueName: \"kubernetes.io/projected/7de029b2-c874-4bcb-a6d3-89333999798b-kube-api-access-jwvtg\") pod \"maas-controller-75c4bf7446-ph2c6\" (UID: \"7de029b2-c874-4bcb-a6d3-89333999798b\") " pod="opendatahub/maas-controller-75c4bf7446-ph2c6"
May 20 20:32:34.223741 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.223661    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9z2c\" (UniqueName: \"kubernetes.io/projected/9ff1f26b-f117-4527-a8b5-0694c0c327fc-kube-api-access-z9z2c\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:32:34.264599 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.264563    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c4bf7446-ph2c6"
May 20 20:32:34.388709 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.388687    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c4bf7446-ph2c6"]
May 20 20:32:34.390277 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:32:34.390250    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de029b2_c874_4bcb_a6d3_89333999798b.slice/crio-a9854ca9a67e0abb381b2f424dc36d9f9d71dd066687c427a1c919cf2aed81b8 WatchSource:0}: Error finding container a9854ca9a67e0abb381b2f424dc36d9f9d71dd066687c427a1c919cf2aed81b8: Status 404 returned error can't find the container with id a9854ca9a67e0abb381b2f424dc36d9f9d71dd066687c427a1c919cf2aed81b8
May 20 20:32:34.714751 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.714710    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c4bf7446-ph2c6" event={"ID":"7de029b2-c874-4bcb-a6d3-89333999798b","Type":"ContainerStarted","Data":"a9854ca9a67e0abb381b2f424dc36d9f9d71dd066687c427a1c919cf2aed81b8"}
May 20 20:32:34.715868 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.715846    2575 generic.go:358] "Generic (PLEG): container finished" podID="9ff1f26b-f117-4527-a8b5-0694c0c327fc" containerID="49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76" exitCode=0
May 20 20:32:34.715945 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.715877    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785f576c9c-628g5" event={"ID":"9ff1f26b-f117-4527-a8b5-0694c0c327fc","Type":"ContainerDied","Data":"49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76"}
May 20 20:32:34.715945 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.715912    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-785f576c9c-628g5" event={"ID":"9ff1f26b-f117-4527-a8b5-0694c0c327fc","Type":"ContainerDied","Data":"cdc0f4fe1a72759fbdda6313441304f71464408e44f7891257ac535c998b1547"}
May 20 20:32:34.715945 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.715933    2575 scope.go:117] "RemoveContainer" containerID="49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76"
May 20 20:32:34.715945 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.715937    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-785f576c9c-628g5"
May 20 20:32:34.723959 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.723941    2575 scope.go:117] "RemoveContainer" containerID="49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76"
May 20 20:32:34.724229 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:32:34.724184    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76\": container with ID starting with 49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76 not found: ID does not exist" containerID="49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76"
May 20 20:32:34.724335 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.724233    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76"} err="failed to get container status \"49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76\": rpc error: code = NotFound desc = could not find container \"49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76\": container with ID starting with 49a1ca772b9c082f4c2ebf3cb6f571616b233aac21cb85f1096354d3f6952e76 not found: ID does not exist"
May 20 20:32:34.732174 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.732153    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-785f576c9c-628g5"]
May 20 20:32:34.734995 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:34.734976    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-785f576c9c-628g5"]
May 20 20:32:35.721026 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:35.720988    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c4bf7446-ph2c6" event={"ID":"7de029b2-c874-4bcb-a6d3-89333999798b","Type":"ContainerStarted","Data":"ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec"}
May 20 20:32:35.721512 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:35.721051    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75c4bf7446-ph2c6"
May 20 20:32:35.740035 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:35.739985    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-75c4bf7446-ph2c6" podStartSLOduration=2.312449101 podStartE2EDuration="2.739969891s" podCreationTimestamp="2026-05-20 20:32:33 +0000 UTC" firstStartedPulling="2026-05-20 20:32:34.391577664 +0000 UTC m=+760.838159859" lastFinishedPulling="2026-05-20 20:32:34.819098436 +0000 UTC m=+761.265680649" observedRunningTime="2026-05-20 20:32:35.738071039 +0000 UTC m=+762.184653258" watchObservedRunningTime="2026-05-20 20:32:35.739969891 +0000 UTC m=+762.186552108"
May 20 20:32:36.143142 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:36.143099    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff1f26b-f117-4527-a8b5-0694c0c327fc" path="/var/lib/kubelet/pods/9ff1f26b-f117-4527-a8b5-0694c0c327fc/volumes"
May 20 20:32:39.755169 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.755131    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-548df8fbd4-qjcq4"]
May 20 20:32:39.755570 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.755538    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff1f26b-f117-4527-a8b5-0694c0c327fc" containerName="manager"
May 20 20:32:39.755570 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.755550    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff1f26b-f117-4527-a8b5-0694c0c327fc" containerName="manager"
May 20 20:32:39.755642 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.755631    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ff1f26b-f117-4527-a8b5-0694c0c327fc" containerName="manager"
May 20 20:32:39.757762 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.757743    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:32:39.760035 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.760017    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 20 20:32:39.767345 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.767317    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-548df8fbd4-qjcq4"]
May 20 20:32:39.875183 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.875144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65z9v\" (UniqueName: \"kubernetes.io/projected/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-kube-api-access-65z9v\") pod \"maas-api-548df8fbd4-qjcq4\" (UID: \"13bf5b20-6c6f-4dbd-82df-ffc7c7689468\") " pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:32:39.875183 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.875185    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-maas-api-tls\") pod \"maas-api-548df8fbd4-qjcq4\" (UID: \"13bf5b20-6c6f-4dbd-82df-ffc7c7689468\") " pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:32:39.976254 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.976217    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65z9v\" (UniqueName: \"kubernetes.io/projected/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-kube-api-access-65z9v\") pod \"maas-api-548df8fbd4-qjcq4\" (UID: \"13bf5b20-6c6f-4dbd-82df-ffc7c7689468\") " pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:32:39.976417 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.976263    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-maas-api-tls\") pod \"maas-api-548df8fbd4-qjcq4\" (UID: \"13bf5b20-6c6f-4dbd-82df-ffc7c7689468\") " pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:32:39.976474 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:32:39.976421    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 20 20:32:39.976509 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:32:39.976495    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-maas-api-tls podName:13bf5b20-6c6f-4dbd-82df-ffc7c7689468 nodeName:}" failed. No retries permitted until 2026-05-20 20:32:40.476474764 +0000 UTC m=+766.923056979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-maas-api-tls") pod "maas-api-548df8fbd4-qjcq4" (UID: "13bf5b20-6c6f-4dbd-82df-ffc7c7689468") : secret "maas-api-serving-cert" not found
May 20 20:32:39.985773 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:39.985744    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65z9v\" (UniqueName: \"kubernetes.io/projected/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-kube-api-access-65z9v\") pod \"maas-api-548df8fbd4-qjcq4\" (UID: \"13bf5b20-6c6f-4dbd-82df-ffc7c7689468\") " pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:32:40.163938 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.163902    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-ffg2n"]
May 20 20:32:40.166660 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.166639    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-ffg2n"
May 20 20:32:40.169987 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.169961    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-n2nlc\""
May 20 20:32:40.170107 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.170023    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 20 20:32:40.179967 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.179942    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-ffg2n"]
May 20 20:32:40.279036 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.279001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgd9v\" (UniqueName: \"kubernetes.io/projected/88321a56-ecc8-46a8-8d2c-90a44f9876fa-kube-api-access-rgd9v\") pod \"payload-processing-58b6c8fdc7-ffg2n\" (UID: \"88321a56-ecc8-46a8-8d2c-90a44f9876fa\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-ffg2n"
May 20 20:32:40.379781 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.379744    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgd9v\" (UniqueName: \"kubernetes.io/projected/88321a56-ecc8-46a8-8d2c-90a44f9876fa-kube-api-access-rgd9v\") pod \"payload-processing-58b6c8fdc7-ffg2n\" (UID: \"88321a56-ecc8-46a8-8d2c-90a44f9876fa\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-ffg2n"
May 20 20:32:40.389421 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.389393    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgd9v\" (UniqueName: \"kubernetes.io/projected/88321a56-ecc8-46a8-8d2c-90a44f9876fa-kube-api-access-rgd9v\") pod \"payload-processing-58b6c8fdc7-ffg2n\" (UID: \"88321a56-ecc8-46a8-8d2c-90a44f9876fa\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-ffg2n"
May 20 20:32:40.477506 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.477432    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-ffg2n"
May 20 20:32:40.481745 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.480468    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-maas-api-tls\") pod \"maas-api-548df8fbd4-qjcq4\" (UID: \"13bf5b20-6c6f-4dbd-82df-ffc7c7689468\") " pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:32:40.483293 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.483267    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-maas-api-tls\") pod \"maas-api-548df8fbd4-qjcq4\" (UID: \"13bf5b20-6c6f-4dbd-82df-ffc7c7689468\") " pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:32:40.618784 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.618756    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-ffg2n"]
May 20 20:32:40.620941 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:32:40.620914    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88321a56_ecc8_46a8_8d2c_90a44f9876fa.slice/crio-2c4a5233d5fbd6af59664425d603c951c939d5729ad996c0b7e7987c41bc1c35 WatchSource:0}: Error finding container 2c4a5233d5fbd6af59664425d603c951c939d5729ad996c0b7e7987c41bc1c35: Status 404 returned error can't find the container with id 2c4a5233d5fbd6af59664425d603c951c939d5729ad996c0b7e7987c41bc1c35
May 20 20:32:40.669496 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.669452    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:32:40.740564 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.740482    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-ffg2n" event={"ID":"88321a56-ecc8-46a8-8d2c-90a44f9876fa","Type":"ContainerStarted","Data":"2c4a5233d5fbd6af59664425d603c951c939d5729ad996c0b7e7987c41bc1c35"}
May 20 20:32:40.805829 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:40.805803    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-548df8fbd4-qjcq4"]
May 20 20:32:40.807159 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:32:40.807129    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bf5b20_6c6f_4dbd_82df_ffc7c7689468.slice/crio-e2ef0964fa241e5000c9f5ab7018ee7e43f382d5387d3345f738d820db6fa409 WatchSource:0}: Error finding container e2ef0964fa241e5000c9f5ab7018ee7e43f382d5387d3345f738d820db6fa409: Status 404 returned error can't find the container with id e2ef0964fa241e5000c9f5ab7018ee7e43f382d5387d3345f738d820db6fa409
May 20 20:32:41.746730 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:41.746669    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-548df8fbd4-qjcq4" event={"ID":"13bf5b20-6c6f-4dbd-82df-ffc7c7689468","Type":"ContainerStarted","Data":"e2ef0964fa241e5000c9f5ab7018ee7e43f382d5387d3345f738d820db6fa409"}
May 20 20:32:44.763086 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:44.763052    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-ffg2n" event={"ID":"88321a56-ecc8-46a8-8d2c-90a44f9876fa","Type":"ContainerStarted","Data":"1b5b82387417d5c4209c5b402e4f2e8e05fc8eb95eca2c4cbf68839f0fe606b1"}
May 20 20:32:44.763607 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:44.763154    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-ffg2n"
May 20 20:32:44.764479 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:44.764451    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-548df8fbd4-qjcq4" event={"ID":"13bf5b20-6c6f-4dbd-82df-ffc7c7689468","Type":"ContainerStarted","Data":"12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae"}
May 20 20:32:44.764582 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:44.764491    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:32:44.779039 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:44.779001    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-ffg2n" podStartSLOduration=1.623682267 podStartE2EDuration="4.778989014s" podCreationTimestamp="2026-05-20 20:32:40 +0000 UTC" firstStartedPulling="2026-05-20 20:32:40.622754241 +0000 UTC m=+767.069336436" lastFinishedPulling="2026-05-20 20:32:43.778060974 +0000 UTC m=+770.224643183" observedRunningTime="2026-05-20 20:32:44.778507876 +0000 UTC m=+771.225090092" watchObservedRunningTime="2026-05-20 20:32:44.778989014 +0000 UTC m=+771.225571230"
May 20 20:32:44.795214 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:44.795146    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-548df8fbd4-qjcq4" podStartSLOduration=2.856143508 podStartE2EDuration="5.795131442s" podCreationTimestamp="2026-05-20 20:32:39 +0000 UTC" firstStartedPulling="2026-05-20 20:32:40.80848725 +0000 UTC m=+767.255069447" lastFinishedPulling="2026-05-20 20:32:43.747475175 +0000 UTC m=+770.194057381" observedRunningTime="2026-05-20 20:32:44.792749298 +0000 UTC m=+771.239331515" watchObservedRunningTime="2026-05-20 20:32:44.795131442 +0000 UTC m=+771.241713691"
May 20 20:32:46.731573 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:46.731539    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75c4bf7446-ph2c6"
May 20 20:32:46.773391 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:46.773358    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b48d64b66-cxbbn"]
May 20 20:32:46.773591 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:46.773569    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7b48d64b66-cxbbn" podUID="5ebfbfa9-a9b4-4d47-b123-9523415adc0a" containerName="manager" containerID="cri-o://7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15" gracePeriod=30
May 20 20:32:47.019545 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.019520    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b48d64b66-cxbbn"
May 20 20:32:47.165781 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.165746    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gljlp\" (UniqueName: \"kubernetes.io/projected/5ebfbfa9-a9b4-4d47-b123-9523415adc0a-kube-api-access-gljlp\") pod \"5ebfbfa9-a9b4-4d47-b123-9523415adc0a\" (UID: \"5ebfbfa9-a9b4-4d47-b123-9523415adc0a\") "
May 20 20:32:47.167798 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.167766    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebfbfa9-a9b4-4d47-b123-9523415adc0a-kube-api-access-gljlp" (OuterVolumeSpecName: "kube-api-access-gljlp") pod "5ebfbfa9-a9b4-4d47-b123-9523415adc0a" (UID: "5ebfbfa9-a9b4-4d47-b123-9523415adc0a"). InnerVolumeSpecName "kube-api-access-gljlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:32:47.266922 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.266815    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gljlp\" (UniqueName: \"kubernetes.io/projected/5ebfbfa9-a9b4-4d47-b123-9523415adc0a-kube-api-access-gljlp\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:32:47.776451 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.776413    2575 generic.go:358] "Generic (PLEG): container finished" podID="5ebfbfa9-a9b4-4d47-b123-9523415adc0a" containerID="7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15" exitCode=0
May 20 20:32:47.776910 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.776466    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b48d64b66-cxbbn" event={"ID":"5ebfbfa9-a9b4-4d47-b123-9523415adc0a","Type":"ContainerDied","Data":"7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15"}
May 20 20:32:47.776910 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.776474    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b48d64b66-cxbbn"
May 20 20:32:47.776910 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.776493    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b48d64b66-cxbbn" event={"ID":"5ebfbfa9-a9b4-4d47-b123-9523415adc0a","Type":"ContainerDied","Data":"75027a31a89bf14c02be4cdd7b3778631df87fc87df018fe90d4ac9ab7a2fcdd"}
May 20 20:32:47.776910 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.776511    2575 scope.go:117] "RemoveContainer" containerID="7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15"
May 20 20:32:47.785788 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.785764    2575 scope.go:117] "RemoveContainer" containerID="7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15"
May 20 20:32:47.786069 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:32:47.786050    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15\": container with ID starting with 7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15 not found: ID does not exist" containerID="7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15"
May 20 20:32:47.786129 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.786080    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15"} err="failed to get container status \"7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15\": rpc error: code = NotFound desc = could not find container \"7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15\": container with ID starting with 7e57cce1cdccf0f0b259653eed07a9dbb6280d5cef08b433468a140a96cfad15 not found: ID does not exist"
May 20 20:32:47.798458 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.798418    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b48d64b66-cxbbn"]
May 20 20:32:47.804039 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:47.804011    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b48d64b66-cxbbn"]
May 20 20:32:48.144172 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:48.144130    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebfbfa9-a9b4-4d47-b123-9523415adc0a" path="/var/lib/kubelet/pods/5ebfbfa9-a9b4-4d47-b123-9523415adc0a/volumes"
May 20 20:32:50.773971 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:50.773945    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:32:52.526374 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:52.526336    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:32:52.526813 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:52.526551    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak" containerID="cri-o://754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e" gracePeriod=30
May 20 20:32:54.073636 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.073613    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 20:32:54.128337 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.128305    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mmsr\" (UniqueName: \"kubernetes.io/projected/4577fea6-37b0-4583-9656-9032a0ae567c-kube-api-access-5mmsr\") pod \"4577fea6-37b0-4583-9656-9032a0ae567c\" (UID: \"4577fea6-37b0-4583-9656-9032a0ae567c\") "
May 20 20:32:54.130580 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.130549    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4577fea6-37b0-4583-9656-9032a0ae567c-kube-api-access-5mmsr" (OuterVolumeSpecName: "kube-api-access-5mmsr") pod "4577fea6-37b0-4583-9656-9032a0ae567c" (UID: "4577fea6-37b0-4583-9656-9032a0ae567c"). InnerVolumeSpecName "kube-api-access-5mmsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:32:54.229314 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.229229    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mmsr\" (UniqueName: \"kubernetes.io/projected/4577fea6-37b0-4583-9656-9032a0ae567c-kube-api-access-5mmsr\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:32:54.803537 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.803500    2575 generic.go:358] "Generic (PLEG): container finished" podID="4577fea6-37b0-4583-9656-9032a0ae567c" containerID="754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e" exitCode=143
May 20 20:32:54.803679 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.803560    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 20:32:54.803679 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.803588    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4577fea6-37b0-4583-9656-9032a0ae567c","Type":"ContainerDied","Data":"754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e"}
May 20 20:32:54.803679 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.803644    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4577fea6-37b0-4583-9656-9032a0ae567c","Type":"ContainerDied","Data":"163c00b4c53948bcb703d735c105d322b8b5199f6abd33dda282c56eddcf2b97"}
May 20 20:32:54.803679 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.803673    2575 scope.go:117] "RemoveContainer" containerID="754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e"
May 20 20:32:54.812580 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.812565    2575 scope.go:117] "RemoveContainer" containerID="754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e"
May 20 20:32:54.812842 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:32:54.812823    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e\": container with ID starting with 754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e not found: ID does not exist" containerID="754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e"
May 20 20:32:54.812887 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.812854    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e"} err="failed to get container status \"754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e\": rpc error: code = NotFound desc = could not find container \"754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e\": container with ID starting with 754b1f39bc219b835afb6613604cce3dff67aa143eeab54919f6f67f9781e02e not found: ID does not exist"
May 20 20:32:54.821142 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.821119    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:32:54.827600 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.827574    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:32:54.853815 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.853791    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:32:54.854221 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.854208    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ebfbfa9-a9b4-4d47-b123-9523415adc0a" containerName="manager"
May 20 20:32:54.854280 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.854223    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ebfbfa9-a9b4-4d47-b123-9523415adc0a" containerName="manager"
May 20 20:32:54.854280 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.854232    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak"
May 20 20:32:54.854280 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.854237    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak"
May 20 20:32:54.854373 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.854307    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ebfbfa9-a9b4-4d47-b123-9523415adc0a" containerName="manager"
May 20 20:32:54.854373 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.854318    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" containerName="keycloak"
May 20 20:32:54.857274 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.857258    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 20:32:54.859757 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.859739    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 20 20:32:54.860164 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.860142    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
May 20 20:32:54.860279 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.860159    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
May 20 20:32:54.860279 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.860163    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 20 20:32:54.860279 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.860187    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-79fhq\""
May 20 20:32:54.868182 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.868163    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:32:54.935125 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.935086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8c60d5f0-483a-41cf-a2bf-37995861e115-test-realms\") pod \"maas-keycloak-0\" (UID: \"8c60d5f0-483a-41cf-a2bf-37995861e115\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:32:54.935324 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:54.935217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zlvf\" (UniqueName: \"kubernetes.io/projected/8c60d5f0-483a-41cf-a2bf-37995861e115-kube-api-access-5zlvf\") pod \"maas-keycloak-0\" (UID: \"8c60d5f0-483a-41cf-a2bf-37995861e115\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:32:55.036378 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:55.036342    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zlvf\" (UniqueName: \"kubernetes.io/projected/8c60d5f0-483a-41cf-a2bf-37995861e115-kube-api-access-5zlvf\") pod \"maas-keycloak-0\" (UID: \"8c60d5f0-483a-41cf-a2bf-37995861e115\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:32:55.036523 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:55.036400    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8c60d5f0-483a-41cf-a2bf-37995861e115-test-realms\") pod \"maas-keycloak-0\" (UID: \"8c60d5f0-483a-41cf-a2bf-37995861e115\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:32:55.037059 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:55.037039    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/8c60d5f0-483a-41cf-a2bf-37995861e115-test-realms\") pod \"maas-keycloak-0\" (UID: \"8c60d5f0-483a-41cf-a2bf-37995861e115\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:32:55.045882 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:55.045859    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zlvf\" (UniqueName: \"kubernetes.io/projected/8c60d5f0-483a-41cf-a2bf-37995861e115-kube-api-access-5zlvf\") pod \"maas-keycloak-0\" (UID: \"8c60d5f0-483a-41cf-a2bf-37995861e115\") " pod="keycloak-system/maas-keycloak-0"
May 20 20:32:55.166907 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:55.166876    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
May 20 20:32:55.311838 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:55.311805    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
May 20 20:32:55.314326 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:32:55.314293    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c60d5f0_483a_41cf_a2bf_37995861e115.slice/crio-95bc2d91fa131fde5d2a0bc56bc4af52d0b1417c09a99f20e8707281cb6138a7 WatchSource:0}: Error finding container 95bc2d91fa131fde5d2a0bc56bc4af52d0b1417c09a99f20e8707281cb6138a7: Status 404 returned error can't find the container with id 95bc2d91fa131fde5d2a0bc56bc4af52d0b1417c09a99f20e8707281cb6138a7
May 20 20:32:55.769960 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:55.769931    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-ffg2n"
May 20 20:32:55.810118 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:55.810088    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8c60d5f0-483a-41cf-a2bf-37995861e115","Type":"ContainerStarted","Data":"95bc2d91fa131fde5d2a0bc56bc4af52d0b1417c09a99f20e8707281cb6138a7"}
May 20 20:32:56.153157 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:56.153120    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4577fea6-37b0-4583-9656-9032a0ae567c" path="/var/lib/kubelet/pods/4577fea6-37b0-4583-9656-9032a0ae567c/volumes"
May 20 20:32:56.820430 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:56.820316    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8c60d5f0-483a-41cf-a2bf-37995861e115","Type":"ContainerStarted","Data":"b70940bb7cf1b84d67ac57a089933dba273541f4936e04fa544262d1526b0bb5"}
May 20 20:32:56.844310 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:56.844233    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.384840589 podStartE2EDuration="2.84421575s" podCreationTimestamp="2026-05-20 20:32:54 +0000 UTC" firstStartedPulling="2026-05-20 20:32:55.315707339 +0000 UTC m=+781.762289538" lastFinishedPulling="2026-05-20 20:32:55.775082503 +0000 UTC m=+782.221664699" observedRunningTime="2026-05-20 20:32:56.841523256 +0000 UTC m=+783.288105479" watchObservedRunningTime="2026-05-20 20:32:56.84421575 +0000 UTC m=+783.290797964"
May 20 20:32:57.167545 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:57.167514    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
May 20 20:32:57.168995 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:57.168962    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:32:58.167334 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:58.167296    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:32:59.167605 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:32:59.167556    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:33:00.167561 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:00.167516    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:33:01.168158 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:01.168105    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:33:02.167602 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:02.167552    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:33:03.168370 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:03.168309    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:33:04.168141 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:04.168102    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:33:05.167604 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:05.167553    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
May 20 20:33:05.168110 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:05.167923    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:33:06.167671 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.167620    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:33:06.514598 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.514491    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-58d6b9d5dc-h5jg4"]
May 20 20:33:06.518303 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.518271    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-58d6b9d5dc-h5jg4"
May 20 20:33:06.521068 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.521047    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7tt4d\""
May 20 20:33:06.526626 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.526599    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-58d6b9d5dc-h5jg4"]
May 20 20:33:06.562361 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.562312    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a58549f-aa15-408f-b6c6-e911fbac2319-maas-api-tls\") pod \"maas-api-58d6b9d5dc-h5jg4\" (UID: \"3a58549f-aa15-408f-b6c6-e911fbac2319\") " pod="opendatahub/maas-api-58d6b9d5dc-h5jg4"
May 20 20:33:06.562728 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.562706    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w2pl\" (UniqueName: \"kubernetes.io/projected/3a58549f-aa15-408f-b6c6-e911fbac2319-kube-api-access-2w2pl\") pod \"maas-api-58d6b9d5dc-h5jg4\" (UID: \"3a58549f-aa15-408f-b6c6-e911fbac2319\") " pod="opendatahub/maas-api-58d6b9d5dc-h5jg4"
May 20 20:33:06.663329 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.663293    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2w2pl\" (UniqueName: \"kubernetes.io/projected/3a58549f-aa15-408f-b6c6-e911fbac2319-kube-api-access-2w2pl\") pod \"maas-api-58d6b9d5dc-h5jg4\" (UID: \"3a58549f-aa15-408f-b6c6-e911fbac2319\") " pod="opendatahub/maas-api-58d6b9d5dc-h5jg4"
May 20 20:33:06.663530 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.663358    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a58549f-aa15-408f-b6c6-e911fbac2319-maas-api-tls\") pod \"maas-api-58d6b9d5dc-h5jg4\" (UID: \"3a58549f-aa15-408f-b6c6-e911fbac2319\") " pod="opendatahub/maas-api-58d6b9d5dc-h5jg4"
May 20 20:33:06.666018 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.665981    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a58549f-aa15-408f-b6c6-e911fbac2319-maas-api-tls\") pod \"maas-api-58d6b9d5dc-h5jg4\" (UID: \"3a58549f-aa15-408f-b6c6-e911fbac2319\") " pod="opendatahub/maas-api-58d6b9d5dc-h5jg4"
May 20 20:33:06.672316 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.672280    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w2pl\" (UniqueName: \"kubernetes.io/projected/3a58549f-aa15-408f-b6c6-e911fbac2319-kube-api-access-2w2pl\") pod \"maas-api-58d6b9d5dc-h5jg4\" (UID: \"3a58549f-aa15-408f-b6c6-e911fbac2319\") " pod="opendatahub/maas-api-58d6b9d5dc-h5jg4"
May 20 20:33:06.833532 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:06.833426    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-58d6b9d5dc-h5jg4"
May 20 20:33:07.025715 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:07.025676    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-58d6b9d5dc-h5jg4"]
May 20 20:33:07.031412 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:33:07.031370    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a58549f_aa15_408f_b6c6_e911fbac2319.slice/crio-6119f8c6c8671cd161e71142ff5ff8d53afaa9b9e6a42080e5f95d69b8330162 WatchSource:0}: Error finding container 6119f8c6c8671cd161e71142ff5ff8d53afaa9b9e6a42080e5f95d69b8330162: Status 404 returned error can't find the container with id 6119f8c6c8671cd161e71142ff5ff8d53afaa9b9e6a42080e5f95d69b8330162
May 20 20:33:07.167623 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:07.167576    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:33:07.873093 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:07.873051    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-58d6b9d5dc-h5jg4" event={"ID":"3a58549f-aa15-408f-b6c6-e911fbac2319","Type":"ContainerStarted","Data":"6119f8c6c8671cd161e71142ff5ff8d53afaa9b9e6a42080e5f95d69b8330162"}
May 20 20:33:08.168479 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:08.168380    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:33:09.169390 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:09.169321    2575 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.44:9000/health/started\": dial tcp 10.133.0.44:9000: connect: connection refused"
May 20 20:33:09.885517 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:09.885471    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-58d6b9d5dc-h5jg4" event={"ID":"3a58549f-aa15-408f-b6c6-e911fbac2319","Type":"ContainerStarted","Data":"ee57ada745dc109ba2269f4dafa902d04cfe48e26520b5aa48402cb6738e4f6a"}
May 20 20:33:09.885743 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:09.885699    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-58d6b9d5dc-h5jg4"
May 20 20:33:09.905575 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:09.903757    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-58d6b9d5dc-h5jg4" podStartSLOduration=2.095291567 podStartE2EDuration="3.903739564s" podCreationTimestamp="2026-05-20 20:33:06 +0000 UTC" firstStartedPulling="2026-05-20 20:33:07.033050296 +0000 UTC m=+793.479632505" lastFinishedPulling="2026-05-20 20:33:08.841498304 +0000 UTC m=+795.288080502" observedRunningTime="2026-05-20 20:33:09.90291928 +0000 UTC m=+796.349501498" watchObservedRunningTime="2026-05-20 20:33:09.903739564 +0000 UTC m=+796.350321783"
May 20 20:33:10.288095 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:10.287978    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
May 20 20:33:10.302534 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:10.302478    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8c60d5f0-483a-41cf-a2bf-37995861e115" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 20:33:15.900422 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:15.900321    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-58d6b9d5dc-h5jg4"
May 20 20:33:15.955089 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:15.955051    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-548df8fbd4-qjcq4"]
May 20 20:33:15.956228 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:15.955621    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-548df8fbd4-qjcq4" podUID="13bf5b20-6c6f-4dbd-82df-ffc7c7689468" containerName="maas-api" containerID="cri-o://12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae" gracePeriod=30
May 20 20:33:16.257601 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.257515    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:33:16.365547 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.365508    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-maas-api-tls\") pod \"13bf5b20-6c6f-4dbd-82df-ffc7c7689468\" (UID: \"13bf5b20-6c6f-4dbd-82df-ffc7c7689468\") "
May 20 20:33:16.365753 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.365567    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65z9v\" (UniqueName: \"kubernetes.io/projected/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-kube-api-access-65z9v\") pod \"13bf5b20-6c6f-4dbd-82df-ffc7c7689468\" (UID: \"13bf5b20-6c6f-4dbd-82df-ffc7c7689468\") "
May 20 20:33:16.369439 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.369326    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-kube-api-access-65z9v" (OuterVolumeSpecName: "kube-api-access-65z9v") pod "13bf5b20-6c6f-4dbd-82df-ffc7c7689468" (UID: "13bf5b20-6c6f-4dbd-82df-ffc7c7689468"). InnerVolumeSpecName "kube-api-access-65z9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:33:16.369439 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.369401    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "13bf5b20-6c6f-4dbd-82df-ffc7c7689468" (UID: "13bf5b20-6c6f-4dbd-82df-ffc7c7689468"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 20:33:16.466855 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.466806    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-maas-api-tls\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:33:16.466855 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.466847    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65z9v\" (UniqueName: \"kubernetes.io/projected/13bf5b20-6c6f-4dbd-82df-ffc7c7689468-kube-api-access-65z9v\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:33:16.918939 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.918894    2575 generic.go:358] "Generic (PLEG): container finished" podID="13bf5b20-6c6f-4dbd-82df-ffc7c7689468" containerID="12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae" exitCode=0
May 20 20:33:16.919448 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.918989    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-548df8fbd4-qjcq4" event={"ID":"13bf5b20-6c6f-4dbd-82df-ffc7c7689468","Type":"ContainerDied","Data":"12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae"}
May 20 20:33:16.919448 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.919021    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-548df8fbd4-qjcq4" event={"ID":"13bf5b20-6c6f-4dbd-82df-ffc7c7689468","Type":"ContainerDied","Data":"e2ef0964fa241e5000c9f5ab7018ee7e43f382d5387d3345f738d820db6fa409"}
May 20 20:33:16.919448 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.919042    2575 scope.go:117] "RemoveContainer" containerID="12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae"
May 20 20:33:16.919448 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.919247    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-548df8fbd4-qjcq4"
May 20 20:33:16.928786 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.928763    2575 scope.go:117] "RemoveContainer" containerID="12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae"
May 20 20:33:16.929137 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:33:16.929103    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae\": container with ID starting with 12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae not found: ID does not exist" containerID="12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae"
May 20 20:33:16.929267 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.929145    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae"} err="failed to get container status \"12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae\": rpc error: code = NotFound desc = could not find container \"12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae\": container with ID starting with 12fde8b922884267f48e2bac55a42773a37c2722d7edd31712213b8a065c67ae not found: ID does not exist"
May 20 20:33:16.952176 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.952139    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-548df8fbd4-qjcq4"]
May 20 20:33:16.958215 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:16.958152    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-548df8fbd4-qjcq4"]
May 20 20:33:18.143962 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:18.143927    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13bf5b20-6c6f-4dbd-82df-ffc7c7689468" path="/var/lib/kubelet/pods/13bf5b20-6c6f-4dbd-82df-ffc7c7689468/volumes"
May 20 20:33:20.294251 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:20.294219    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
May 20 20:33:53.653984 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.653947    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"]
May 20 20:33:53.654661 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.654639    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13bf5b20-6c6f-4dbd-82df-ffc7c7689468" containerName="maas-api"
May 20 20:33:53.654784 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.654708    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="13bf5b20-6c6f-4dbd-82df-ffc7c7689468" containerName="maas-api"
May 20 20:33:53.654857 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.654828    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="13bf5b20-6c6f-4dbd-82df-ffc7c7689468" containerName="maas-api"
May 20 20:33:53.658334 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.658314    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.661928 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.661911    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 20 20:33:53.662028 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.661927    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 20 20:33:53.662028 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.661912    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6ktj8\""
May 20 20:33:53.662028 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.661999    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 20 20:33:53.667298 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.667269    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"]
May 20 20:33:53.818279 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.818250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.818535 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.818295    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.818535 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.818320    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.818535 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.818375    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.818535 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.818394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dz47\" (UniqueName: \"kubernetes.io/projected/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-kube-api-access-7dz47\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.818535 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.818466    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.919361 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.919268    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.919361 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.919316    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.919547 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.919430    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.919547 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.919487    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.919547 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.919514    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dz47\" (UniqueName: \"kubernetes.io/projected/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-kube-api-access-7dz47\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.919657 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.919566    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.919702 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.919676    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.919766 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.919748    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.919863 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.919844    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.921631 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.921613    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.921822 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.921805    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.929696 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.929670    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dz47\" (UniqueName: \"kubernetes.io/projected/0d69ac97-aab1-4c56-9839-4a4d30f8ab18-kube-api-access-7dz47\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx\" (UID: \"0d69ac97-aab1-4c56-9839-4a4d30f8ab18\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:53.969791 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:53.969757    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:33:54.112204 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:54.112162    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"]
May 20 20:33:54.113674 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:33:54.113639    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d69ac97_aab1_4c56_9839_4a4d30f8ab18.slice/crio-f35131f5ae9129cae137bedc6e0560863352cd1e8c71e7dd529cce20fa946a50 WatchSource:0}: Error finding container f35131f5ae9129cae137bedc6e0560863352cd1e8c71e7dd529cce20fa946a50: Status 404 returned error can't find the container with id f35131f5ae9129cae137bedc6e0560863352cd1e8c71e7dd529cce20fa946a50
May 20 20:33:55.058841 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:33:55.058804    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx" event={"ID":"0d69ac97-aab1-4c56-9839-4a4d30f8ab18","Type":"ContainerStarted","Data":"f35131f5ae9129cae137bedc6e0560863352cd1e8c71e7dd529cce20fa946a50"}
May 20 20:34:01.087303 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:01.087263    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx" event={"ID":"0d69ac97-aab1-4c56-9839-4a4d30f8ab18","Type":"ContainerStarted","Data":"5dc37b0252ccf3c4c337b8c602934185006334a51c3a9e5b6f4e96c3cd77de4a"}
May 20 20:34:06.237343 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:34:06.237304    2575 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d69ac97_aab1_4c56_9839_4a4d30f8ab18.slice/crio-5dc37b0252ccf3c4c337b8c602934185006334a51c3a9e5b6f4e96c3cd77de4a.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d69ac97_aab1_4c56_9839_4a4d30f8ab18.slice/crio-conmon-5dc37b0252ccf3c4c337b8c602934185006334a51c3a9e5b6f4e96c3cd77de4a.scope\": RecentStats: unable to find data in memory cache]"
May 20 20:34:07.111799 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:07.111760    2575 generic.go:358] "Generic (PLEG): container finished" podID="0d69ac97-aab1-4c56-9839-4a4d30f8ab18" containerID="5dc37b0252ccf3c4c337b8c602934185006334a51c3a9e5b6f4e96c3cd77de4a" exitCode=0
May 20 20:34:07.112109 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:07.111839    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx" event={"ID":"0d69ac97-aab1-4c56-9839-4a4d30f8ab18","Type":"ContainerDied","Data":"5dc37b0252ccf3c4c337b8c602934185006334a51c3a9e5b6f4e96c3cd77de4a"}
May 20 20:34:09.121026 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:09.120977    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx" event={"ID":"0d69ac97-aab1-4c56-9839-4a4d30f8ab18","Type":"ContainerStarted","Data":"8b47f65976e368b824435280f4cb09933d0e040fc95ac9b522fe14d50bdbfea8"}
May 20 20:34:09.121491 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:09.121237    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:34:09.141597 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:09.141541    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx" podStartSLOduration=1.988356553 podStartE2EDuration="16.141523208s" podCreationTimestamp="2026-05-20 20:33:53 +0000 UTC" firstStartedPulling="2026-05-20 20:33:54.115407738 +0000 UTC m=+840.561989933" lastFinishedPulling="2026-05-20 20:34:08.268574391 +0000 UTC m=+854.715156588" observedRunningTime="2026-05-20 20:34:09.139131458 +0000 UTC m=+855.585713695" watchObservedRunningTime="2026-05-20 20:34:09.141523208 +0000 UTC m=+855.588105425"
May 20 20:34:11.035516 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.035454    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"]
May 20 20:34:11.040998 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.040974    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.043329 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.043305    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 20 20:34:11.047222 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.047172    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"]
May 20 20:34:11.095437 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.095402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de890180-a210-4c69-884e-44c13a5a1e67-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.095653 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.095476    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.095653 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.095504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.095653 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.095534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.095653 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.095575    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.095653 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.095639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w5l2\" (UniqueName: \"kubernetes.io/projected/de890180-a210-4c69-884e-44c13a5a1e67-kube-api-access-6w5l2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.196173 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.196132    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.196401 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.196224    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5l2\" (UniqueName: \"kubernetes.io/projected/de890180-a210-4c69-884e-44c13a5a1e67-kube-api-access-6w5l2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.196401 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.196296    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de890180-a210-4c69-884e-44c13a5a1e67-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.196401 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.196357    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.196401 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.196380    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.196619 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.196416    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.196619 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.196567    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.196750 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.196688    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.196791 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.196746    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.198564 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.198541    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de890180-a210-4c69-884e-44c13a5a1e67-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.198803 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.198787    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de890180-a210-4c69-884e-44c13a5a1e67-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.203927 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.203902    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w5l2\" (UniqueName: \"kubernetes.io/projected/de890180-a210-4c69-884e-44c13a5a1e67-kube-api-access-6w5l2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2\" (UID: \"de890180-a210-4c69-884e-44c13a5a1e67\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.353397 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.353277    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:11.493130 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:11.493096    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"]
May 20 20:34:11.496841 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:34:11.496802    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde890180_a210_4c69_884e_44c13a5a1e67.slice/crio-343b005a7c1bfc6831d151fb24c9e64de568ca0fde7fa4c7471e7467ea3cb617 WatchSource:0}: Error finding container 343b005a7c1bfc6831d151fb24c9e64de568ca0fde7fa4c7471e7467ea3cb617: Status 404 returned error can't find the container with id 343b005a7c1bfc6831d151fb24c9e64de568ca0fde7fa4c7471e7467ea3cb617
May 20 20:34:12.134475 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:12.134438    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2" event={"ID":"de890180-a210-4c69-884e-44c13a5a1e67","Type":"ContainerStarted","Data":"922bbf62ec5f72dc30d26d6a24188f83e22771dfe8151f169d9ef9616e3d6faf"}
May 20 20:34:12.134475 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:12.134477    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2" event={"ID":"de890180-a210-4c69-884e-44c13a5a1e67","Type":"ContainerStarted","Data":"343b005a7c1bfc6831d151fb24c9e64de568ca0fde7fa4c7471e7467ea3cb617"}
May 20 20:34:14.327441 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.327397    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"]
May 20 20:34:14.331532 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.331507    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.333797 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.333769    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 20 20:34:14.340747 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.340723    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"]
May 20 20:34:14.429186 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.429153    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.429186 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.429205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.429460 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.429370    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqprp\" (UniqueName: \"kubernetes.io/projected/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-kube-api-access-gqprp\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.429460 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.429418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.429460 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.429453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.429649 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.429573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.531062 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.531022    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqprp\" (UniqueName: \"kubernetes.io/projected/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-kube-api-access-gqprp\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.531062 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.531065    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.531337 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.531095    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.531337 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.531158    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.531337 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.531278    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.531337 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.531320    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.531548 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.531512    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.531660 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.531634    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.531705 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.531690    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.533516 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.533486    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.533920 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.533901    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.547554 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.547524    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqprp\" (UniqueName: \"kubernetes.io/projected/da95cc4e-c3bb-4bfb-97cb-90294031ea9c-kube-api-access-gqprp\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl\" (UID: \"da95cc4e-c3bb-4bfb-97cb-90294031ea9c\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.643837 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.643802    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:14.802503 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:14.802472    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"]
May 20 20:34:14.804008 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:34:14.803977    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda95cc4e_c3bb_4bfb_97cb_90294031ea9c.slice/crio-1c30e12ebe281a97d6eb5cb6bd5d877c2cb92a3de0fc72af807e84ba7fb005f6 WatchSource:0}: Error finding container 1c30e12ebe281a97d6eb5cb6bd5d877c2cb92a3de0fc72af807e84ba7fb005f6: Status 404 returned error can't find the container with id 1c30e12ebe281a97d6eb5cb6bd5d877c2cb92a3de0fc72af807e84ba7fb005f6
May 20 20:34:15.147349 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:15.147313    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl" event={"ID":"da95cc4e-c3bb-4bfb-97cb-90294031ea9c","Type":"ContainerStarted","Data":"6b6494d54d9ca46c270432f7c9b5f13daf08fd3c29210d68d19fdbdd98e3926f"}
May 20 20:34:15.147349 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:15.147352    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl" event={"ID":"da95cc4e-c3bb-4bfb-97cb-90294031ea9c","Type":"ContainerStarted","Data":"1c30e12ebe281a97d6eb5cb6bd5d877c2cb92a3de0fc72af807e84ba7fb005f6"}
May 20 20:34:18.162178 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:18.162137    2575 generic.go:358] "Generic (PLEG): container finished" podID="de890180-a210-4c69-884e-44c13a5a1e67" containerID="922bbf62ec5f72dc30d26d6a24188f83e22771dfe8151f169d9ef9616e3d6faf" exitCode=0
May 20 20:34:18.162595 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:18.162220    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2" event={"ID":"de890180-a210-4c69-884e-44c13a5a1e67","Type":"ContainerDied","Data":"922bbf62ec5f72dc30d26d6a24188f83e22771dfe8151f169d9ef9616e3d6faf"}
May 20 20:34:19.167877 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:19.167840    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2" event={"ID":"de890180-a210-4c69-884e-44c13a5a1e67","Type":"ContainerStarted","Data":"6235e5632db3b03912bf0a2fdf114f86ffc0ab1d3ce07c33e1a4ee69185a8845"}
May 20 20:34:19.168306 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:19.168052    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:19.189464 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:19.189411    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2" podStartSLOduration=7.994538931 podStartE2EDuration="8.189396398s" podCreationTimestamp="2026-05-20 20:34:11 +0000 UTC" firstStartedPulling="2026-05-20 20:34:18.162866899 +0000 UTC m=+864.609449094" lastFinishedPulling="2026-05-20 20:34:18.357724364 +0000 UTC m=+864.804306561" observedRunningTime="2026-05-20 20:34:19.18755881 +0000 UTC m=+865.634141026" watchObservedRunningTime="2026-05-20 20:34:19.189396398 +0000 UTC m=+865.635978614"
May 20 20:34:20.138250 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:20.138187    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx"
May 20 20:34:21.179249 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:21.179187    2575 generic.go:358] "Generic (PLEG): container finished" podID="da95cc4e-c3bb-4bfb-97cb-90294031ea9c" containerID="6b6494d54d9ca46c270432f7c9b5f13daf08fd3c29210d68d19fdbdd98e3926f" exitCode=0
May 20 20:34:21.179618 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:21.179223    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl" event={"ID":"da95cc4e-c3bb-4bfb-97cb-90294031ea9c","Type":"ContainerDied","Data":"6b6494d54d9ca46c270432f7c9b5f13daf08fd3c29210d68d19fdbdd98e3926f"}
May 20 20:34:22.184093 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:22.184049    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl" event={"ID":"da95cc4e-c3bb-4bfb-97cb-90294031ea9c","Type":"ContainerStarted","Data":"9efd684a52ce030771dd8c4f95a134e542b5d943f45e6ec697cad4f262b9c843"}
May 20 20:34:22.184540 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:22.184316    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:22.212540 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:22.212492    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl" podStartSLOduration=7.705147106 podStartE2EDuration="8.212476015s" podCreationTimestamp="2026-05-20 20:34:14 +0000 UTC" firstStartedPulling="2026-05-20 20:34:21.17993486 +0000 UTC m=+867.626517055" lastFinishedPulling="2026-05-20 20:34:21.687263766 +0000 UTC m=+868.133845964" observedRunningTime="2026-05-20 20:34:22.210891477 +0000 UTC m=+868.657473692" watchObservedRunningTime="2026-05-20 20:34:22.212476015 +0000 UTC m=+868.659058232"
May 20 20:34:30.184430 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:30.184400    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2"
May 20 20:34:33.200920 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:33.200888    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl"
May 20 20:34:54.128724 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:54.128646    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:34:54.129947 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:54.129926    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:34:54.135305 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:54.135284    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:34:54.136267 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:34:54.136245    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:36:16.999583 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:16.999483    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75c4bf7446-ph2c6"]
May 20 20:36:17.000150 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:16.999793    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-75c4bf7446-ph2c6" podUID="7de029b2-c874-4bcb-a6d3-89333999798b" containerName="manager" containerID="cri-o://ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec" gracePeriod=30
May 20 20:36:17.268528 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.268504    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c4bf7446-ph2c6"
May 20 20:36:17.349707 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.349669    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwvtg\" (UniqueName: \"kubernetes.io/projected/7de029b2-c874-4bcb-a6d3-89333999798b-kube-api-access-jwvtg\") pod \"7de029b2-c874-4bcb-a6d3-89333999798b\" (UID: \"7de029b2-c874-4bcb-a6d3-89333999798b\") "
May 20 20:36:17.351687 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.351663    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de029b2-c874-4bcb-a6d3-89333999798b-kube-api-access-jwvtg" (OuterVolumeSpecName: "kube-api-access-jwvtg") pod "7de029b2-c874-4bcb-a6d3-89333999798b" (UID: "7de029b2-c874-4bcb-a6d3-89333999798b"). InnerVolumeSpecName "kube-api-access-jwvtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:36:17.451068 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.451030    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwvtg\" (UniqueName: \"kubernetes.io/projected/7de029b2-c874-4bcb-a6d3-89333999798b-kube-api-access-jwvtg\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:36:17.632535 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.632501    2575 generic.go:358] "Generic (PLEG): container finished" podID="7de029b2-c874-4bcb-a6d3-89333999798b" containerID="ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec" exitCode=0
May 20 20:36:17.632731 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.632578    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c4bf7446-ph2c6"
May 20 20:36:17.632731 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.632591    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c4bf7446-ph2c6" event={"ID":"7de029b2-c874-4bcb-a6d3-89333999798b","Type":"ContainerDied","Data":"ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec"}
May 20 20:36:17.632731 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.632637    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c4bf7446-ph2c6" event={"ID":"7de029b2-c874-4bcb-a6d3-89333999798b","Type":"ContainerDied","Data":"a9854ca9a67e0abb381b2f424dc36d9f9d71dd066687c427a1c919cf2aed81b8"}
May 20 20:36:17.632731 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.632658    2575 scope.go:117] "RemoveContainer" containerID="ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec"
May 20 20:36:17.641441 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.641424    2575 scope.go:117] "RemoveContainer" containerID="ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec"
May 20 20:36:17.641717 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:36:17.641701    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec\": container with ID starting with ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec not found: ID does not exist" containerID="ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec"
May 20 20:36:17.641776 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.641723    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec"} err="failed to get container status \"ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec\": rpc error: code = NotFound desc = could not find container \"ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec\": container with ID starting with ac83a96e3dfe39c524b557c8d266ed29d6058500c6efeff4a01051a4e3bc63ec not found: ID does not exist"
May 20 20:36:17.672058 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.672025    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75c4bf7446-ph2c6"]
May 20 20:36:17.712346 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:17.712314    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75c4bf7446-ph2c6"]
May 20 20:36:18.145175 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.145142    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de029b2-c874-4bcb-a6d3-89333999798b" path="/var/lib/kubelet/pods/7de029b2-c874-4bcb-a6d3-89333999798b/volumes"
May 20 20:36:18.639942 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.639910    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75c4bf7446-m2xd4"]
May 20 20:36:18.640364 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.640349    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de029b2-c874-4bcb-a6d3-89333999798b" containerName="manager"
May 20 20:36:18.640411 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.640366    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de029b2-c874-4bcb-a6d3-89333999798b" containerName="manager"
May 20 20:36:18.640451 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.640443    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="7de029b2-c874-4bcb-a6d3-89333999798b" containerName="manager"
May 20 20:36:18.643579 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.643561    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c4bf7446-m2xd4"
May 20 20:36:18.668149 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.668116    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sglhc\""
May 20 20:36:18.695595 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.695564    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c4bf7446-m2xd4"]
May 20 20:36:18.762492 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.762460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d4rs\" (UniqueName: \"kubernetes.io/projected/40795c01-d4aa-4da9-8693-86b620e4301a-kube-api-access-5d4rs\") pod \"maas-controller-75c4bf7446-m2xd4\" (UID: \"40795c01-d4aa-4da9-8693-86b620e4301a\") " pod="opendatahub/maas-controller-75c4bf7446-m2xd4"
May 20 20:36:18.863942 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.863905    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5d4rs\" (UniqueName: \"kubernetes.io/projected/40795c01-d4aa-4da9-8693-86b620e4301a-kube-api-access-5d4rs\") pod \"maas-controller-75c4bf7446-m2xd4\" (UID: \"40795c01-d4aa-4da9-8693-86b620e4301a\") " pod="opendatahub/maas-controller-75c4bf7446-m2xd4"
May 20 20:36:18.878030 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.877993    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d4rs\" (UniqueName: \"kubernetes.io/projected/40795c01-d4aa-4da9-8693-86b620e4301a-kube-api-access-5d4rs\") pod \"maas-controller-75c4bf7446-m2xd4\" (UID: \"40795c01-d4aa-4da9-8693-86b620e4301a\") " pod="opendatahub/maas-controller-75c4bf7446-m2xd4"
May 20 20:36:18.953146 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:18.953053    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75c4bf7446-m2xd4"
May 20 20:36:19.097380 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:19.097289    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75c4bf7446-m2xd4"]
May 20 20:36:19.100053 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:36:19.100026    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40795c01_d4aa_4da9_8693_86b620e4301a.slice/crio-0b01893b00875a09b94b79fd176e82836d39601a8d9ee79a16a3effa234d3539 WatchSource:0}: Error finding container 0b01893b00875a09b94b79fd176e82836d39601a8d9ee79a16a3effa234d3539: Status 404 returned error can't find the container with id 0b01893b00875a09b94b79fd176e82836d39601a8d9ee79a16a3effa234d3539
May 20 20:36:19.101657 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:19.101632    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:36:19.641869 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:19.641842    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c4bf7446-m2xd4" event={"ID":"40795c01-d4aa-4da9-8693-86b620e4301a","Type":"ContainerStarted","Data":"0b01893b00875a09b94b79fd176e82836d39601a8d9ee79a16a3effa234d3539"}
May 20 20:36:20.647226 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:20.647181    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75c4bf7446-m2xd4" event={"ID":"40795c01-d4aa-4da9-8693-86b620e4301a","Type":"ContainerStarted","Data":"cf46a64f1e5418c30012bd5c9b29e10ce3db173a670ce28b0708b08a8b76c881"}
May 20 20:36:20.647615 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:20.647245    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75c4bf7446-m2xd4"
May 20 20:36:20.679975 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:20.679908    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-75c4bf7446-m2xd4" podStartSLOduration=2.15596034 podStartE2EDuration="2.679885464s" podCreationTimestamp="2026-05-20 20:36:18 +0000 UTC" firstStartedPulling="2026-05-20 20:36:19.101791366 +0000 UTC m=+985.548373564" lastFinishedPulling="2026-05-20 20:36:19.625716489 +0000 UTC m=+986.072298688" observedRunningTime="2026-05-20 20:36:20.677611849 +0000 UTC m=+987.124194090" watchObservedRunningTime="2026-05-20 20:36:20.679885464 +0000 UTC m=+987.126467683"
May 20 20:36:31.666775 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:36:31.666744    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75c4bf7446-m2xd4"
May 20 20:39:54.162677 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:39:54.162646    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:39:54.163217 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:39:54.162854    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:39:54.168658 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:39:54.168640    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:39:54.168774 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:39:54.168674    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:44:54.189414 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:44:54.189385    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:44:54.191435 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:44:54.191411    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:44:54.195696 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:44:54.195681    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:44:54.197163 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:44:54.197147    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:46:43.847991 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:43.847899    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"]
May 20 20:46:43.848577 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:43.848206    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6" podUID="ffffb18a-4a31-4ba9-b81d-3f1995714ddc" containerName="manager" containerID="cri-o://bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3" gracePeriod=10
May 20 20:46:44.695669 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.695640    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:46:44.784859 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.784772    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvjc8\" (UniqueName: \"kubernetes.io/projected/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-kube-api-access-pvjc8\") pod \"ffffb18a-4a31-4ba9-b81d-3f1995714ddc\" (UID: \"ffffb18a-4a31-4ba9-b81d-3f1995714ddc\") "
May 20 20:46:44.784859 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.784822    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-extensions-socket-volume\") pod \"ffffb18a-4a31-4ba9-b81d-3f1995714ddc\" (UID: \"ffffb18a-4a31-4ba9-b81d-3f1995714ddc\") "
May 20 20:46:44.785255 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.785233    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ffffb18a-4a31-4ba9-b81d-3f1995714ddc" (UID: "ffffb18a-4a31-4ba9-b81d-3f1995714ddc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 20:46:44.786826 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.786807    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-kube-api-access-pvjc8" (OuterVolumeSpecName: "kube-api-access-pvjc8") pod "ffffb18a-4a31-4ba9-b81d-3f1995714ddc" (UID: "ffffb18a-4a31-4ba9-b81d-3f1995714ddc"). InnerVolumeSpecName "kube-api-access-pvjc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 20:46:44.886463 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.886429    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvjc8\" (UniqueName: \"kubernetes.io/projected/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-kube-api-access-pvjc8\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:46:44.886463 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.886455    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffffb18a-4a31-4ba9-b81d-3f1995714ddc-extensions-socket-volume\") on node \"ip-10-0-138-220.ec2.internal\" DevicePath \"\""
May 20 20:46:44.985020 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.984983    2575 generic.go:358] "Generic (PLEG): container finished" podID="ffffb18a-4a31-4ba9-b81d-3f1995714ddc" containerID="bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3" exitCode=0
May 20 20:46:44.985255 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.985043    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"
May 20 20:46:44.985255 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.985058    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6" event={"ID":"ffffb18a-4a31-4ba9-b81d-3f1995714ddc","Type":"ContainerDied","Data":"bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3"}
May 20 20:46:44.985255 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.985091    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6" event={"ID":"ffffb18a-4a31-4ba9-b81d-3f1995714ddc","Type":"ContainerDied","Data":"72e092624fef5199e733d844f07503381ead13f57060660771b1a2a772749dcc"}
May 20 20:46:44.985255 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.985110    2575 scope.go:117] "RemoveContainer" containerID="bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3"
May 20 20:46:44.994459 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.994441    2575 scope.go:117] "RemoveContainer" containerID="bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3"
May 20 20:46:44.994725 ip-10-0-138-220 kubenswrapper[2575]: E0520 20:46:44.994706    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3\": container with ID starting with bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3 not found: ID does not exist" containerID="bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3"
May 20 20:46:44.994790 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:44.994733    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3"} err="failed to get container status \"bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3\": rpc error: code = NotFound desc = could not find container \"bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3\": container with ID starting with bcd4f12202d31b93c943d464965b0cb70478de2c6ddc6ec4d45a130908c00fb3 not found: ID does not exist"
May 20 20:46:45.007787 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:45.007756    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"]
May 20 20:46:45.011238 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:45.011213    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z54r6"]
May 20 20:46:46.143916 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:46:46.143875    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffffb18a-4a31-4ba9-b81d-3f1995714ddc" path="/var/lib/kubelet/pods/ffffb18a-4a31-4ba9-b81d-3f1995714ddc/volumes"
May 20 20:47:49.961496 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:49.961461    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"]
May 20 20:47:49.961986 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:49.961898    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffffb18a-4a31-4ba9-b81d-3f1995714ddc" containerName="manager"
May 20 20:47:49.961986 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:49.961909    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffffb18a-4a31-4ba9-b81d-3f1995714ddc" containerName="manager"
May 20 20:47:49.961986 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:49.961975    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffffb18a-4a31-4ba9-b81d-3f1995714ddc" containerName="manager"
May 20 20:47:49.965015 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:49.964996    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"
May 20 20:47:49.972116 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:49.972096    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x8tdl\""
May 20 20:47:49.991485 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:49.991453    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"]
May 20 20:47:50.128340 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:50.128302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/220aaaf2-0558-4d92-bbd1-ae43df55cd61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jq9fk\" (UID: \"220aaaf2-0558-4d92-bbd1-ae43df55cd61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"
May 20 20:47:50.128522 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:50.128368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zzww\" (UniqueName: \"kubernetes.io/projected/220aaaf2-0558-4d92-bbd1-ae43df55cd61-kube-api-access-5zzww\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jq9fk\" (UID: \"220aaaf2-0558-4d92-bbd1-ae43df55cd61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"
May 20 20:47:50.229762 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:50.229660    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/220aaaf2-0558-4d92-bbd1-ae43df55cd61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jq9fk\" (UID: \"220aaaf2-0558-4d92-bbd1-ae43df55cd61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"
May 20 20:47:50.229986 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:50.229961    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zzww\" (UniqueName: \"kubernetes.io/projected/220aaaf2-0558-4d92-bbd1-ae43df55cd61-kube-api-access-5zzww\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jq9fk\" (UID: \"220aaaf2-0558-4d92-bbd1-ae43df55cd61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"
May 20 20:47:50.230238 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:50.230087    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/220aaaf2-0558-4d92-bbd1-ae43df55cd61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jq9fk\" (UID: \"220aaaf2-0558-4d92-bbd1-ae43df55cd61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"
May 20 20:47:50.246061 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:50.246027    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zzww\" (UniqueName: \"kubernetes.io/projected/220aaaf2-0558-4d92-bbd1-ae43df55cd61-kube-api-access-5zzww\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jq9fk\" (UID: \"220aaaf2-0558-4d92-bbd1-ae43df55cd61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"
May 20 20:47:50.275021 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:50.274988    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"
May 20 20:47:50.435856 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:50.435831    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"]
May 20 20:47:50.438410 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:47:50.438381    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod220aaaf2_0558_4d92_bbd1_ae43df55cd61.slice/crio-d84861925e17e43f91e3da04641aa0efc3668ed9d5feb222cbdf31631fb37d89 WatchSource:0}: Error finding container d84861925e17e43f91e3da04641aa0efc3668ed9d5feb222cbdf31631fb37d89: Status 404 returned error can't find the container with id d84861925e17e43f91e3da04641aa0efc3668ed9d5feb222cbdf31631fb37d89
May 20 20:47:50.440558 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:50.440542    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:47:51.221484 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:51.221449    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk" event={"ID":"220aaaf2-0558-4d92-bbd1-ae43df55cd61","Type":"ContainerStarted","Data":"0d4e74298fe8440ab274b1dcc950559f501d1813c2ab60a28fcfcbbc33447af4"}
May 20 20:47:51.221484 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:51.221485    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk" event={"ID":"220aaaf2-0558-4d92-bbd1-ae43df55cd61","Type":"ContainerStarted","Data":"d84861925e17e43f91e3da04641aa0efc3668ed9d5feb222cbdf31631fb37d89"}
May 20 20:47:51.221911 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:51.221588    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"
May 20 20:47:51.244405 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:47:51.244357    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk" podStartSLOduration=2.244343308 podStartE2EDuration="2.244343308s" podCreationTimestamp="2026-05-20 20:47:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:47:51.243233918 +0000 UTC m=+1677.689816137" watchObservedRunningTime="2026-05-20 20:47:51.244343308 +0000 UTC m=+1677.690925525"
May 20 20:48:02.226818 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:48:02.226788    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jq9fk"
May 20 20:49:54.219118 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:49:54.219085    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:49:54.220503 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:49:54.220480    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:49:54.229300 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:49:54.229280    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:49:54.230542 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:49:54.230519    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:54:54.252703 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:54:54.252664    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:54:54.255053 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:54:54.254784    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:54:54.259449 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:54:54.259430    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:54:54.261215 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:54:54.261184    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kdcdj_59f569cb-5ecd-41a0-8d28-5cc6a76211af/ovn-acl-logging/0.log"
May 20 20:57:41.865591 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:41.865561    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-58d6b9d5dc-h5jg4_3a58549f-aa15-408f-b6c6-e911fbac2319/maas-api/0.log"
May 20 20:57:42.086635 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:42.086594    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75c4bf7446-m2xd4_40795c01-d4aa-4da9-8693-86b620e4301a/manager/0.log"
May 20 20:57:42.320421 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:42.320388    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c978b984-5mjz7_77329b3f-fe92-48fe-9b4d-21f817f1eda0/manager/0.log"
May 20 20:57:44.051098 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:44.051064    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-s9zh8_44cb6800-22ef-4aba-8ee7-0981045279fd/manager/0.log"
May 20 20:57:44.155232 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:44.155187    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-67x7q_27de6293-f980-432c-b266-4cb542438b7c/manager/0.log"
May 20 20:57:44.382808 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:44.382780    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nqmnn_77f97689-2c7e-4fc2-b6a3-373c73d25468/registry-server/0.log"
May 20 20:57:44.500501 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:44.500461    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-jq9fk_220aaaf2-0558-4d92-bbd1-ae43df55cd61/manager/0.log"
May 20 20:57:45.069415 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:45.069384    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x_e8af515e-9ab9-47e6-aa8e-a8bad81a96bc/istio-proxy/0.log"
May 20 20:57:45.509636 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:45.509605    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-jmxnv_6ed96c21-22ba-4202-8d4b-7efb1b6dc03c/istio-proxy/0.log"
May 20 20:57:45.624858 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:45.624821    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-ffg2n_88321a56-ecc8-46a8-8d2c-90a44f9876fa/payload-processing/0.log"
May 20 20:57:46.060603 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:46.060573    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl_da95cc4e-c3bb-4bfb-97cb-90294031ea9c/storage-initializer/0.log"
May 20 20:57:46.067666 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:46.067643    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-hm2zl_da95cc4e-c3bb-4bfb-97cb-90294031ea9c/main/0.log"
May 20 20:57:46.408778 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:46.408743    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2_de890180-a210-4c69-884e-44c13a5a1e67/storage-initializer/0.log"
May 20 20:57:46.416892 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:46.416870    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccc4kg2_de890180-a210-4c69-884e-44c13a5a1e67/main/0.log"
May 20 20:57:46.531097 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:46.531069    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx_0d69ac97-aab1-4c56-9839-4a4d30f8ab18/storage-initializer/0.log"
May 20 20:57:46.542634 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:46.542603    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-dfvvx_0d69ac97-aab1-4c56-9839-4a4d30f8ab18/main/0.log"
May 20 20:57:54.358362 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:54.358322    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r2r4m_e02a3a83-a1de-4d01-b205-7fb737a4c5cc/global-pull-secret-syncer/0.log"
May 20 20:57:54.526395 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:54.526365    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jzhww_1024ee22-2e8f-410b-be16-302ef6e7b0eb/konnectivity-agent/0.log"
May 20 20:57:54.629886 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:54.629854    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-220.ec2.internal_742e74dfb476718f2640591828e6c470/haproxy/0.log"
May 20 20:57:58.751772 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:58.751738    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-s9zh8_44cb6800-22ef-4aba-8ee7-0981045279fd/manager/0.log"
May 20 20:57:58.797986 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:58.797960    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-67x7q_27de6293-f980-432c-b266-4cb542438b7c/manager/0.log"
May 20 20:57:58.886551 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:58.886521    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nqmnn_77f97689-2c7e-4fc2-b6a3-373c73d25468/registry-server/0.log"
May 20 20:57:58.970999 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:57:58.970963    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-jq9fk_220aaaf2-0558-4d92-bbd1-ae43df55cd61/manager/0.log"
May 20 20:58:00.702648 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:00.702615    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-dpm5g_01d1d8a5-7939-436e-8466-03ac29e4af5b/cluster-monitoring-operator/0.log"
May 20 20:58:00.761723 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:00.761693    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wxhtn_4577d96d-dca9-4b87-a7df-7cb08fbc7bba/kube-state-metrics/0.log"
May 20 20:58:00.832471 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:00.832447    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wxhtn_4577d96d-dca9-4b87-a7df-7cb08fbc7bba/kube-rbac-proxy-main/0.log"
May 20 20:58:00.921246 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:00.921214    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-wxhtn_4577d96d-dca9-4b87-a7df-7cb08fbc7bba/kube-rbac-proxy-self/0.log"
May 20 20:58:00.977062 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:00.977036    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7687886c84-fzgd5_d31da29a-e7d6-4d9a-a2ac-8e46fd38c545/metrics-server/0.log"
May 20 20:58:01.234644 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.234616    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxhxr_12d271c1-d1d8-4666-a488-8a1bd9660958/node-exporter/0.log"
May 20 20:58:01.261521 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.261486    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxhxr_12d271c1-d1d8-4666-a488-8a1bd9660958/kube-rbac-proxy/0.log"
May 20 20:58:01.284399 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.284374    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxhxr_12d271c1-d1d8-4666-a488-8a1bd9660958/init-textfile/0.log"
May 20 20:58:01.332277 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.332240    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-rtb5v_83ab18cb-572d-4d9f-94cc-fad361d991ce/kube-rbac-proxy-main/0.log"
May 20 20:58:01.357657 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.357626    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-rtb5v_83ab18cb-572d-4d9f-94cc-fad361d991ce/kube-rbac-proxy-self/0.log"
May 20 20:58:01.379581 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.379551    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-rtb5v_83ab18cb-572d-4d9f-94cc-fad361d991ce/openshift-state-metrics/0.log"
May 20 20:58:01.421834 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.421807    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a71786b-f612-46a3-95b1-81071a028aef/prometheus/0.log"
May 20 20:58:01.452353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.452324    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a71786b-f612-46a3-95b1-81071a028aef/config-reloader/0.log"
May 20 20:58:01.477047 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.477022    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a71786b-f612-46a3-95b1-81071a028aef/thanos-sidecar/0.log"
May 20 20:58:01.506531 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.506453    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a71786b-f612-46a3-95b1-81071a028aef/kube-rbac-proxy-web/0.log"
May 20 20:58:01.541025 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.540993    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a71786b-f612-46a3-95b1-81071a028aef/kube-rbac-proxy/0.log"
May 20 20:58:01.568329 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.568299    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a71786b-f612-46a3-95b1-81071a028aef/kube-rbac-proxy-thanos/0.log"
May 20 20:58:01.596249 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.596165    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a71786b-f612-46a3-95b1-81071a028aef/init-config-reloader/0.log"
May 20 20:58:01.691629 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.691603    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-m4qvt_fdb5dd5b-66f4-43b3-96c1-47ef62f7ac0a/prometheus-operator-admission-webhook/0.log"
May 20 20:58:01.807605 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.807532    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5957879bcd-4krdb_12fd368d-0a3f-4b33-8746-c6cb09bbee32/thanos-query/0.log"
May 20 20:58:01.832983 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.832958    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5957879bcd-4krdb_12fd368d-0a3f-4b33-8746-c6cb09bbee32/kube-rbac-proxy-web/0.log"
May 20 20:58:01.857063 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.857026    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5957879bcd-4krdb_12fd368d-0a3f-4b33-8746-c6cb09bbee32/kube-rbac-proxy/0.log"
May 20 20:58:01.878373 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.878343    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5957879bcd-4krdb_12fd368d-0a3f-4b33-8746-c6cb09bbee32/prom-label-proxy/0.log"
May 20 20:58:01.900946 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.900922    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5957879bcd-4krdb_12fd368d-0a3f-4b33-8746-c6cb09bbee32/kube-rbac-proxy-rules/0.log"
May 20 20:58:01.924039 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:01.924013    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5957879bcd-4krdb_12fd368d-0a3f-4b33-8746-c6cb09bbee32/kube-rbac-proxy-metrics/0.log"
May 20 20:58:02.474353 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.474309    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"]
May 20 20:58:02.478410 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.478384    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.481609 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.481588    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q87q4\"/\"kube-root-ca.crt\""
May 20 20:58:02.481825 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.481803    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q87q4\"/\"openshift-service-ca.crt\""
May 20 20:58:02.482534 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.482511    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q87q4\"/\"default-dockercfg-8zml2\""
May 20 20:58:02.489057 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.489030    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"]
May 20 20:58:02.590835 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.590787    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-sys\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.590835 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.590850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-proc\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.591120 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.590938    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwg2p\" (UniqueName: \"kubernetes.io/projected/32618bc8-3b9a-47a3-84bd-65c36f232c5c-kube-api-access-xwg2p\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.591120 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.590996    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-podres\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.591120 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.591077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-lib-modules\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.691798 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.691749    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-lib-modules\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.691993 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.691815    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-sys\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.691993 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.691846    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-proc\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.691993 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.691875    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwg2p\" (UniqueName: \"kubernetes.io/projected/32618bc8-3b9a-47a3-84bd-65c36f232c5c-kube-api-access-xwg2p\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.691993 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.691914    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-podres\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.691993 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.691951    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-sys\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.691993 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.691966    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-proc\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.691993 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.691953    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-lib-modules\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.692396 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.692030    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32618bc8-3b9a-47a3-84bd-65c36f232c5c-podres\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.700706 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.700677    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwg2p\" (UniqueName: \"kubernetes.io/projected/32618bc8-3b9a-47a3-84bd-65c36f232c5c-kube-api-access-xwg2p\") pod \"perf-node-gather-daemonset-6hffx\" (UID: \"32618bc8-3b9a-47a3-84bd-65c36f232c5c\") " pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.788877 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.788768    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:02.936478 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.936453    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"]
May 20 20:58:02.938745 ip-10-0-138-220 kubenswrapper[2575]: W0520 20:58:02.938712    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod32618bc8_3b9a_47a3_84bd_65c36f232c5c.slice/crio-26f9704f6d047b86cecfccf00e694382c75ce4812cf3fab40a531bc52823ac2f WatchSource:0}: Error finding container 26f9704f6d047b86cecfccf00e694382c75ce4812cf3fab40a531bc52823ac2f: Status 404 returned error can't find the container with id 26f9704f6d047b86cecfccf00e694382c75ce4812cf3fab40a531bc52823ac2f
May 20 20:58:02.940380 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:02.940360    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:58:03.521482 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:03.521444    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx" event={"ID":"32618bc8-3b9a-47a3-84bd-65c36f232c5c","Type":"ContainerStarted","Data":"f71cf0ff3893215a40cbf1e0924be49a95abe23531b1d8d703310a0cbd0697c7"}
May 20 20:58:03.521482 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:03.521488    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx" event={"ID":"32618bc8-3b9a-47a3-84bd-65c36f232c5c","Type":"ContainerStarted","Data":"26f9704f6d047b86cecfccf00e694382c75ce4812cf3fab40a531bc52823ac2f"}
May 20 20:58:03.521754 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:03.521534    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:03.546586 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:03.546534    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx" podStartSLOduration=1.54651995 podStartE2EDuration="1.54651995s" podCreationTimestamp="2026-05-20 20:58:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:58:03.544548076 +0000 UTC m=+2289.991130294" watchObservedRunningTime="2026-05-20 20:58:03.54651995 +0000 UTC m=+2289.993102190"
May 20 20:58:03.709069 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:03.709024    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/2.log"
May 20 20:58:03.714399 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:03.714362    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-252gl_26c57738-105f-421c-82aa-1261642326be/console-operator/3.log"
May 20 20:58:04.772695 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:04.772668    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-8fc89_281e3d99-9eb1-40d3-bf4b-fd4753b568fb/volume-data-source-validator/0.log"
May 20 20:58:05.673594 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:05.673560    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8w2r7_c12b8325-2b1d-4837-9d3d-7df8fb7b4f58/dns/0.log"
May 20 20:58:05.734162 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:05.734135    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8w2r7_c12b8325-2b1d-4837-9d3d-7df8fb7b4f58/kube-rbac-proxy/0.log"
May 20 20:58:05.943597 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:05.943510    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z2rgw_a8afe344-be23-4700-9ff6-95fa7d945bd8/dns-node-resolver/0.log"
May 20 20:58:06.415327 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:06.415298    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d75bc698b-vhtbp_84386a5b-6b8a-45da-aa84-f6a252a57727/registry/1.log"
May 20 20:58:06.423133 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:06.423099    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d75bc698b-vhtbp_84386a5b-6b8a-45da-aa84-f6a252a57727/registry/2.log"
May 20 20:58:06.451131 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:06.451102    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dbzh4_159c1ebf-42c3-4fe7-b624-208c0435814d/node-ca/0.log"
May 20 20:58:07.361924 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:07.361896    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b5hp9x_e8af515e-9ab9-47e6-aa8e-a8bad81a96bc/istio-proxy/0.log"
May 20 20:58:07.658060 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:07.658023    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-jmxnv_6ed96c21-22ba-4202-8d4b-7efb1b6dc03c/istio-proxy/0.log"
May 20 20:58:07.732458 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:07.732424    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-ffg2n_88321a56-ecc8-46a8-8d2c-90a44f9876fa/payload-processing/0.log"
May 20 20:58:08.286768 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:08.286735    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-288pq_15c1ec37-1eb0-4805-9fb4-f651bb85f3d0/serve-healthcheck-canary/0.log"
May 20 20:58:09.215540 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:09.215508    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zwfzg_bf3f9412-1d90-4eaf-bd89-bd5a649db712/kube-rbac-proxy/0.log"
May 20 20:58:09.256352 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:09.256318    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zwfzg_bf3f9412-1d90-4eaf-bd89-bd5a649db712/exporter/0.log"
May 20 20:58:09.291851 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:09.291814    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zwfzg_bf3f9412-1d90-4eaf-bd89-bd5a649db712/extractor/0.log"
May 20 20:58:09.536980 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:09.536901    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q87q4/perf-node-gather-daemonset-6hffx"
May 20 20:58:11.521973 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:11.521896    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-58d6b9d5dc-h5jg4_3a58549f-aa15-408f-b6c6-e911fbac2319/maas-api/0.log"
May 20 20:58:11.611525 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:11.611496    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75c4bf7446-m2xd4_40795c01-d4aa-4da9-8693-86b620e4301a/manager/0.log"
May 20 20:58:11.693636 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:11.693606    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76c978b984-5mjz7_77329b3f-fe92-48fe-9b4d-21f817f1eda0/manager/0.log"
May 20 20:58:13.193506 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:13.193470    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84d5db74c-knvs4_b3661c98-1aec-4ee1-bb57-f34d832fdcf1/manager/0.log"
May 20 20:58:18.158432 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:18.158398    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-cpww7_64fcfcf2-5717-4003-9c9a-b10e5f4f7089/kube-storage-version-migrator-operator/1.log"
May 20 20:58:18.159233 ip-10-0-138-220 kubenswrapper[2575]: I0520 20:58:18.159186    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-cpww7_64fcfcf2-5717-4003-9c9a-b10e5f4f7089/kube-storage-version-migrator-operator/0.log"